-- Logs begin at Mon 2022-08-22 18:28:58 UTC, end at Mon 2022-08-22 20:23:49 UTC. -- Aug 22 19:38:53.454147 dv-cinder-835384-22-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 19:38:53.463632 dv-cinder-835384-22-smb devstack@keystone.service[93472]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 19:38:53 2022] *** Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: nodename: dv-cinder-835384-22-smb Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: machine: x86_64 Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: clock source: unix Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: pcre jit disabled Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: detected number of CPU cores: 4 Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: current working directory: / Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: detected binary path: /usr/bin/uwsgi-core Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: your processes number limit is 47680 Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: your memory page size is 4096 bytes Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: detected max file descriptor number: 2048 Aug 22 19:38:53.465732 dv-cinder-835384-22-smb devstack@keystone.service[93472]: lock engine: pthread robust mutexes Aug 22 19:38:53.466472 dv-cinder-835384-22-smb devstack@keystone.service[93472]: thunder lock: enabled Aug 22 19:38:53.466472 dv-cinder-835384-22-smb devstack@keystone.service[93472]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 19:38:53.466472 dv-cinder-835384-22-smb devstack@keystone.service[93472]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 19:38:53.504812 dv-cinder-835384-22-smb devstack@keystone.service[93472]: Python main interpreter initialized at 0x55f7053ae9c0 Aug 22 19:38:53.504812 dv-cinder-835384-22-smb devstack@keystone.service[93472]: python threads support enabled Aug 22 19:38:53.504812 dv-cinder-835384-22-smb devstack@keystone.service[93472]: your server socket listen backlog is limited to 100 connections Aug 22 19:38:53.504812 dv-cinder-835384-22-smb devstack@keystone.service[93472]: your mercy for graceful operations on workers is 90 seconds Aug 22 19:38:53.505208 dv-cinder-835384-22-smb devstack@keystone.service[93472]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 19:38:53.505284 dv-cinder-835384-22-smb devstack@keystone.service[93472]: *** Operational MODE: preforking *** Aug 22 19:38:53.505533 dv-cinder-835384-22-smb devstack@keystone.service[93472]: *** uWSGI is running in multiple interpreter mode *** Aug 22 19:38:53.505533 dv-cinder-835384-22-smb devstack@keystone.service[93472]: spawned uWSGI master process (pid: 93472) Aug 22 19:38:53.505746 dv-cinder-835384-22-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 22 19:38:53.508963 dv-cinder-835384-22-smb devstack@keystone.service[93472]: spawned uWSGI worker 1 (pid: 93485, cores: 1) Aug 22 19:38:53.508963 dv-cinder-835384-22-smb devstack@keystone.service[93472]: spawned uWSGI worker 2 (pid: 93486, cores: 1) Aug 22 19:38:53.509302 dv-cinder-835384-22-smb devstack@keystone.service[93472]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 19:38:57.886829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:38:57.886829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: from cryptography.utils import int_from_bytes Aug 22 19:38:57.887660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:38:57.887660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: from cryptography.utils import int_from_bytes Aug 22 19:38:57.891590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:38:57.891590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: from cryptography.utils import int_from_bytes Aug 22 19:38:57.892065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 19:38:57.892065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: from cryptography.utils import int_from_bytes Aug 22 19:38:57.943074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 19:38:57.943302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 19:38:57.943388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 19:38:57.943477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 19:38:57.943556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] command line args: [] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 19:38:57.943639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] command line args: [] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 19:38:57.943739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 19:38:57.943888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 19:38:57.943989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ================================================================================ {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 19:38:57.944068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ================================================================================ {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 19:38:57.944171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] admin_token = **** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.944311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] admin_token = **** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.944446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] config_dir = [] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.944653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] config_dir = [] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.944748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.944822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.944888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] config_source = [] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.945067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] debug = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.945159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] config_source = [] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.945270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.945521 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] debug = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.945596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.945683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.945880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.945967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.946033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.946100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.946256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.946333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.946466 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.946593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] list_limit = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.946724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] list_limit = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.946854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] log_config_append = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.946987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] log_config_append = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.947182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.947356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.947507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] log_dir = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.947589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] log_dir = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.947714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] log_file = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.947798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] log_file = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.947913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.947991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.948924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949854 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.949967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.950045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.950115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.950198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.950297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.950419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.950584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.950700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.951100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.951216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.951354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] publish_errors = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.951432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] publish_errors = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.951545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.951663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.951777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.951849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.951980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.952060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.952169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.952262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.952407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.952487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.952645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] standard_threads = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.952730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] standard_threads = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.952880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.952963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.953123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.953206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.953351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.953464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.953464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] use_journal = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.953694 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] use_journal = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.953792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] use_json = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.953885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] use_json = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.953961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] use_stderr = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.954031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] use_stderr = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.954108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] use_syslog = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.954184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] use_syslog = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.954310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.954394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 19:38:57.954464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.954539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.954735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.954817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.954893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.954963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.955113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.955190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.955399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.955477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.955643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.955720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.955895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.955986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.956137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.956261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.956387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.956521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.956639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.956778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.956892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.957030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.957131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.957270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.957420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.957593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.957677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.957842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.957917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.958092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.958208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.958333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.958417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.958574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.958649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.958832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.958908 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.959081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.959158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.959353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.959438 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.959595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.959672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.959854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.959937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.960159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.960242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.960441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.960555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.960708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.960902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.961026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.961132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.961210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.961368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.961454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.961619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.961695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.961869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.961945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.962102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.962186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.962336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.962411 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.962582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.962656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.962817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.962900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.963057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.963130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.963331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.963410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.963565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.963651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.963804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.963883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.964040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.964116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.964268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.964409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.964534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.964635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.964735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.964867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.964984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.965084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.965179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.965278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.965400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.965505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.965633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.965746 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.965937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.966073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.966171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.966266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.966369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.966475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.966589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.966672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.966794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.966870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.967004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.967085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.967275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.967370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.967503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.967624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.967740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.967826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.967978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.968060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.968211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.968287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.968442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.968570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.968678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.968756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.968911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.968991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.969147 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.969233 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.969378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.969456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.969617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.969699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.969850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.969936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.970091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.970168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.970330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.970449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.970565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.970648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.970804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.970957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.971079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.971176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.971324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.971402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.976364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.976626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.976626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.976813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.976915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.976993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.977158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.977243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.977360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.977434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.977549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.977630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.977753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.977834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.977948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978721 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978869 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.978947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.979974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.980956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] auth.external = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.981954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] auth.external = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] auth.password = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982814 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] auth.token = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.982927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] auth.password = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] auth.token = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983627 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.983972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] credential.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] credential.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.984956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985621 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.985931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.986947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.987020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.987185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.987284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.987481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.987567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.987640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] federation.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.987711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.987831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.987936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.988046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.988250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] federation.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.988376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.988453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.988561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.988639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.988766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.988843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.988957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989533 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.989998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.990937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.991052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.991132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.992039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.992214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.992291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.992409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.992499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.992499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.992821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.992941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.993982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994246 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.994968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.995077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.995159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.995364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.995482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.995602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.995727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.995843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.995921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.996080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.996158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.996322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.996411 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.996554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.996630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.996794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.996871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.997038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.997122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.997283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.997361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.997507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.997600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.997758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.997884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.998008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.998086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.998242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.998320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.998481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.998567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.998717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.998861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.998988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.999180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.999318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.999410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.999484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.999599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.999674 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.999788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.999891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:57.999978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.000130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.000209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.000378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.000459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.000610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.000702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.000843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.000924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.001093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.001174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.001341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.001432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.001576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.001654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.001810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.001891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.002045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.002134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.002278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.002359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.002518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.002599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.002755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.002929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.003016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.003167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.003314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.003447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.003526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.003699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.003950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.004034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.004192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.004273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.004428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.004520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.004669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.004781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.004948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.005068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.005188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.005267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.005422 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.005501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.005664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.005745 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.005904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.005985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.006146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.006227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.006382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.006463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.006629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.006709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.006863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.006983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.007192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.007289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.007501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.007584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.007763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.007842 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.008003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.008084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.008241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.008321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.008751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.008835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.009003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.009081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.009241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.009318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.009480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.009559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.009716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.009793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.009964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.010042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.010209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.010297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.010447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.010529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.010678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.010759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.010924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.011002 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.011167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.011264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.011440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.011524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.011681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.011757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.011921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] resource.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.011997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.012164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.012247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.012406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.012526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.012643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.012734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.012885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] resource.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.012963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.013132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.013209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.013370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.013448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.013608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.013685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.013844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.013921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.014083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.014161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.014321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] role.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.014400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.014569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.014646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] role.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.014799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.014877 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.015039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.015116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.015307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] role.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.015391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.015558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.015636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] role.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.015790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.015961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.016081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.016180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.016313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.016430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.016518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.016591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.016747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.016826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.016983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.017060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.017231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.017310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.017479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.017558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.017730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.017815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.017971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.018049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.018224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.018414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.018493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.018655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.018734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.018908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.019034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.019160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.019406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.019499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.019652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.019730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.019901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.019978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.020151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.020236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.020403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.020482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.020644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.020721 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.020881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.020968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.021116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.021195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.021351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.021429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.021605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.021696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.021841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.021918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.022077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.022155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.022311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.022435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.022566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.022641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.022804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.022872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.023043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] token.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.023165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.023442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.023521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.023592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.023709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.023796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.023930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.024008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.024121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] token.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.024251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.024362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.024492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.024615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.024738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.024856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.024983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.025115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.025233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.025367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.025471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.025607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.025712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.025856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.025942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.026105 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.026184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.026358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.026445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.026598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.026687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.026840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.026921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.027079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.027157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.027351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.027443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.connection = **** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.027604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.027758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.027860 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.027939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.028108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.028192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.028358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.028443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.028595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.028673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.connection = **** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.028831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.028918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.029067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.029146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.029305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.029383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.029551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.029730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.029808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.029880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.030025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.030099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.030247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.030327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.030494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.030572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.030730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.030809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.030975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.031053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.031207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.031364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.031475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.031555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.031713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.031791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.031884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 19:38:58.031963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.032206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.032442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.032689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.032928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 19:38:58.033223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93486) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 19:38:58.062921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.063145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.063402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.063629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.063863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.064087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.072615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.073575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.102834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.103072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.104017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.104253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.159286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.159718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.217750 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.217989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.218770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.219010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.389838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.390031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.390242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.390328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.390484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.390568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.390692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.390772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.390893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.390893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.391308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.391534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.416545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.416725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.416814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.416967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.417053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.417130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.417204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.417374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.417524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.417611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.417761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.417852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.417942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.418020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.429588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.430061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.442934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.443131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.443217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.443318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.443413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.443496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.443636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.443729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.443853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.443932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.444069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.444148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.444282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93486) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.444363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 19:38:58.462713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.462928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 19:38:58.463079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.463284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 19:38:58.463371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.463507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.463589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 19:38:58.463712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 19:38:58.463794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.463995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.464077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.464262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.464570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.464808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.464897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.465079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.474326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.474611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.474839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.474929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.475129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.475213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.475431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.476385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.483192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.483660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.486141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.486436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.486571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.486751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.486888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.487030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.487151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.487345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.487435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.487618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.487718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.487901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.488042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.488173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.488302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.488536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.488736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.488869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.488997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.489125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.489263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.489474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.512867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.513061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.514388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.514584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.516467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.516697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.519493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.519780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.519878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.520072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.520172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.520356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.527401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.527526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.527700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.527790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.531902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.532001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.532216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.532300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.532488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.532571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.532775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.532856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.533054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.533143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.533334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.533414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.533613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.533698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.533890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.533988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.552492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.552682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.552786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.552871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.557628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.557743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.561011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.561120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.561306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.561480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.565582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.565693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.568772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.568886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.572819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.573112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.573204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.573400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.573482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.573807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.573893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.573956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.574029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.574250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.574342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.574546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.590955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.591295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.591496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.591688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.591806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.591963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.592081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.592351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.598997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.599307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.600574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.600898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.601015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.601391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.603699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.603991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.604135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.604290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.604429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.604595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.604726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.604880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.605034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.605318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.616847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.617168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.617497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.617591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.617741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.617839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.618031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.618113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.618408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.618499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.618620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.618839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.618919 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.619186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.635529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.635927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.638646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.639040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.641614 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.641996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.643125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.643480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.644660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.644950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.645041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.645239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.645332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.645539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.652165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.652553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.653653 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.654028 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.656734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.657030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.657113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.657331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.657412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.657618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.657748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.657970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.666159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.666454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.666783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.666871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.667136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.667454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.673853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93486) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.674139 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.674390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 19:38:58.674473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.674683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.674764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.674957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.675038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.675258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.675355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.675532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.675612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.675810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.675891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.676085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.676163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.676356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.676443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.676638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.676719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.676912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.677019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.677186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.677268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.677455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.677536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93486) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.677737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.678012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 19:38:58.713570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f7053ae9c0 pid: 93486 (default app) Aug 22 19:38:58.714830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f7053ae9c0 pid: 93485 (default app) Aug 22 19:38:58.717261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb03d24-8919-4a67-a7cd-32f76416b34c None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:38:58.717552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb03d24-8919-4a67-a7cd-32f76416b34c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:38:58.717826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb03d24-8919-4a67-a7cd-32f76416b34c None None] PATH_INFO: `/v3` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:38:58.722008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Aug 22 19:38:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:06.744397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6cbb-626b-4627-877e-9e546894f242 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:06.744930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6cbb-626b-4627-877e-9e546894f242 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:06.744930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6cbb-626b-4627-877e-9e546894f242 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:06.749390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:06.756527 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:06.757716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:06.757716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:06.829152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: INFO dbcounter [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] Registered counter for database keystone Aug 22 19:39:06.850522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG oslo_db.sqlalchemy.engines [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93486) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:39:06.856957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writer thread running {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:39:07.041941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG passlib.handlers.bcrypt [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93486) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 19:39:07.042265 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG passlib.handlers.bcrypt [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93486) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 19:39:07.098726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:07.100922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:07.234446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 22 19:39:07.689334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6cbb-626b-4627-877e-9e546894f242 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:07.760133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: INFO dbcounter [None req-5d9f6cbb-626b-4627-877e-9e546894f242 None None] Registered counter for database keystone Aug 22 19:39:07.780346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG oslo_db.sqlalchemy.engines [None req-5d9f6cbb-626b-4627-877e-9e546894f242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 19:39:07.786808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writer thread running {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 19:39:07.911743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6cbb-626b-4627-877e-9e546894f242 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:07.916966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c5d4-513c-4a4c-b772-8d054a24c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:07.917604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c5d4-513c-4a4c-b772-8d054a24c17e admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:07.917882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c5d4-513c-4a4c-b772-8d054a24c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:07.918154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c5d4-513c-4a4c-b772-8d054a24c17e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:07.926801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c5d4-513c-4a4c-b772-8d054a24c17e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:07.979316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c0b7c5d4-513c-4a4c-b772-8d054a24c17e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 19:39:07.979591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c5d4-513c-4a4c-b772-8d054a24c17e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:07.990030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Aug 22 19:39:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 19:39:07.996947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:08.012369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8535-a46e-4614-9b23-b996bc7dcfbf None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:08.016832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433864bc-fe64-4645-acc4-515cf5a9848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:08.017957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433864bc-fe64-4645-acc4-515cf5a9848a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:08.018240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433864bc-fe64-4645-acc4-515cf5a9848a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:08.018523 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433864bc-fe64-4645-acc4-515cf5a9848a admin admin] PATH_INFO: `/v3/projects/51271e31587049bcaa892f314e138418` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:08.020148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433864bc-fe64-4645-acc4-515cf5a9848a admin admin] RBAC: Authorizing `identity:get_project(project_id=51271e31587049bcaa892f314e138418)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:08.074566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WARNING keystone.common.rbac_enforcer.enforcer [None req-433864bc-fe64-4645-acc4-515cf5a9848a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 19:39:08.074918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433864bc-fe64-4645-acc4-515cf5a9848a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:08.079634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Aug 22 19:39:07 2022] GET /identity/v3/projects/51271e31587049bcaa892f314e138418 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:10.012081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3710ba-3447-4d60-a85b-db3a72c1b6ee None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:10.012605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3710ba-3447-4d60-a85b-db3a72c1b6ee None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:10.012605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3710ba-3447-4d60-a85b-db3a72c1b6ee None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:10.016772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:10.022640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3905f0-5376-4fe9-9d23-ae66da7ce868 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:10.023092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3905f0-5376-4fe9-9d23-ae66da7ce868 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:10.023204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3905f0-5376-4fe9-9d23-ae66da7ce868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:10.045062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6f3905f0-5376-4fe9-9d23-ae66da7ce868 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:10.046588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6f3905f0-5376-4fe9-9d23-ae66da7ce868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:10.055424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 19:39:10.323962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3710ba-3447-4d60-a85b-db3a72c1b6ee None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:10.336812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3710ba-3447-4d60-a85b-db3a72c1b6ee None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:10.341502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4c07b-41c1-4484-aa3c-b71e5b2011ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:10.342106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4c07b-41c1-4484-aa3c-b71e5b2011ae admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:10.342383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4c07b-41c1-4484-aa3c-b71e5b2011ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:10.342653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4c07b-41c1-4484-aa3c-b71e5b2011ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:10.351456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4c07b-41c1-4484-aa3c-b71e5b2011ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:10.353346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4c07b-41c1-4484-aa3c-b71e5b2011ae admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:10.362450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Aug 22 19:39:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 19:39:10.368766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3905f0-5376-4fe9-9d23-ae66da7ce868 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:10.378134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3905f0-5376-4fe9-9d23-ae66da7ce868 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:10.383615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd801e-49c5-4911-be08-87f0bb446e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:10.384606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd801e-49c5-4911-be08-87f0bb446e07 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:10.385095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd801e-49c5-4911-be08-87f0bb446e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:10.385565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd801e-49c5-4911-be08-87f0bb446e07 admin admin] PATH_INFO: `/v3/users/0cdd881142fc452aa383e6193f9f4daa` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:10.387765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd801e-49c5-4911-be08-87f0bb446e07 admin admin] RBAC: Authorizing `identity:get_user(user_id=0cdd881142fc452aa383e6193f9f4daa)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:10.391065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd801e-49c5-4911-be08-87f0bb446e07 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:10.393909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Aug 22 19:39:10 2022] GET /identity/v3/users/0cdd881142fc452aa383e6193f9f4daa => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:12.396527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d7d49-b83c-415c-9fcc-0de9594b80c1 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:12.396906 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d7d49-b83c-415c-9fcc-0de9594b80c1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:12.397669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d7d49-b83c-415c-9fcc-0de9594b80c1 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:12.399029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:12.404784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6187a2-9474-4477-8bd1-72e1a42f9b3a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:12.405229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6187a2-9474-4477-8bd1-72e1a42f9b3a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:12.405417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6187a2-9474-4477-8bd1-72e1a42f9b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:12.426353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-2d6187a2-9474-4477-8bd1-72e1a42f9b3a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:12.427564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2d6187a2-9474-4477-8bd1-72e1a42f9b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:12.464893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9887f-04aa-4e14-a426-75723c261c6a None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:12.465254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9887f-04aa-4e14-a426-75723c261c6a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:12.465529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9887f-04aa-4e14-a426-75723c261c6a None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:12.467407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:12.473907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b8b54-d592-4816-b66f-a41196652e5d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:12.474191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b8b54-d592-4816-b66f-a41196652e5d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:12.474464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b8b54-d592-4816-b66f-a41196652e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:12.517747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:12.519792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG passlib.handlers.bcrypt [None req-1a8b8b54-d592-4816-b66f-a41196652e5d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93485) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 19:39:12.520227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG passlib.handlers.bcrypt [None req-1a8b8b54-d592-4816-b66f-a41196652e5d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93485) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 19:39:12.566311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-1a8b8b54-d592-4816-b66f-a41196652e5d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:12.568019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1a8b8b54-d592-4816-b66f-a41196652e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:12.674188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:12.784358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6187a2-9474-4477-8bd1-72e1a42f9b3a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:12.809192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:12.898532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6187a2-9474-4477-8bd1-72e1a42f9b3a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:12.935089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18981-6d73-4db2-aa67-8890b1499920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:12.935772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18981-6d73-4db2-aa67-8890b1499920 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:12.936043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18981-6d73-4db2-aa67-8890b1499920 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:12.936318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18981-6d73-4db2-aa67-8890b1499920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:12.947857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf18981-6d73-4db2-aa67-8890b1499920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:12.951089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b8b54-d592-4816-b66f-a41196652e5d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-baf18981-6d73-4db2-aa67-8890b1499920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:12.956798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:12.957834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:12.958609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:12.964266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18981-6d73-4db2-aa67-8890b1499920 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:13.057720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:13.067674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b8b54-d592-4816-b66f-a41196652e5d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:13.072033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:13.081734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18981-6d73-4db2-aa67-8890b1499920 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:13.107873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309966f-5185-44d7-9144-06e7dc779a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:13.108736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309966f-5185-44d7-9144-06e7dc779a0e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:13.109014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309966f-5185-44d7-9144-06e7dc779a0e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:13.109288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309966f-5185-44d7-9144-06e7dc779a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:13.122251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf5d48-6247-4f8a-baef-f37b242964b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:13.122251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf5d48-6247-4f8a-baef-f37b242964b7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:13.122251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf5d48-6247-4f8a-baef-f37b242964b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:13.122251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf5d48-6247-4f8a-baef-f37b242964b7 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:13.122677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf5d48-6247-4f8a-baef-f37b242964b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:13.122677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf5d48-6247-4f8a-baef-f37b242964b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:13.122677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf5d48-6247-4f8a-baef-f37b242964b7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:13.134507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:13.140498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf5d48-6247-4f8a-baef-f37b242964b7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:13.190810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309966f-5185-44d7-9144-06e7dc779a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:13.192384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309966f-5185-44d7-9144-06e7dc779a0e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:13.254608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf5d48-6247-4f8a-baef-f37b242964b7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:13.291747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9720c6-1f8f-4c40-926a-4dadf92464c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:13.292382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9720c6-1f8f-4c40-926a-4dadf92464c6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:13.292666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9720c6-1f8f-4c40-926a-4dadf92464c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:13.292935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9720c6-1f8f-4c40-926a-4dadf92464c6 None admin] PATH_INFO: `/v3/users/0cdd881142fc452aa383e6193f9f4daa` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:13.294083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9720c6-1f8f-4c40-926a-4dadf92464c6 None admin] RBAC: Authorizing `identity:get_user(user_id=0cdd881142fc452aa383e6193f9f4daa)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:13.295577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9720c6-1f8f-4c40-926a-4dadf92464c6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:13.297357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 19:39:13.297473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:13 2022] GET /identity/v3/users/0cdd881142fc452aa383e6193f9f4daa => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:13.302588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9720c6-1f8f-4c40-926a-4dadf92464c6 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:13.302737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309966f-5185-44d7-9144-06e7dc779a0e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:13.305779 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:13.321225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:13.409496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309966f-5185-44d7-9144-06e7dc779a0e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:13.420197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9720c6-1f8f-4c40-926a-4dadf92464c6 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:13.446253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317cebc-3ab3-46d5-a75c-1bed79c5172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:13.447112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317cebc-3ab3-46d5-a75c-1bed79c5172c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:13.447759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317cebc-3ab3-46d5-a75c-1bed79c5172c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:13.447759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317cebc-3ab3-46d5-a75c-1bed79c5172c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:13.455174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf2aaf-1130-4961-9937-ac3e825a294b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:13.455848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf2aaf-1130-4961-9937-ac3e825a294b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:13.456125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf2aaf-1130-4961-9937-ac3e825a294b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:13.456396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf2aaf-1130-4961-9937-ac3e825a294b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:13.457528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf2aaf-1130-4961-9937-ac3e825a294b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:13.458997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf2aaf-1130-4961-9937-ac3e825a294b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:13.461515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:13.467664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf2aaf-1130-4961-9937-ac3e825a294b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:13.467877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317cebc-3ab3-46d5-a75c-1bed79c5172c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:13.469409 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317cebc-3ab3-46d5-a75c-1bed79c5172c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-a317cebc-3ab3-46d5-a75c-1bed79c5172c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:39:13.488673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:13.489603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:39:13.490638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:39:13.490638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:39:13.490638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:13.490638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:13.495907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317cebc-3ab3-46d5-a75c-1bed79c5172c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:13.553157 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:13.562738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:13.573460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf2aaf-1130-4961-9937-ac3e825a294b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:13.612730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317cebc-3ab3-46d5-a75c-1bed79c5172c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:13.615180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada9426-9553-48dd-ad99-75de8266f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:13.615997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada9426-9553-48dd-ad99-75de8266f963 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:13.616276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada9426-9553-48dd-ad99-75de8266f963 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:13.616552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada9426-9553-48dd-ad99-75de8266f963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:13.617289 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada9426-9553-48dd-ad99-75de8266f963 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.domain.id=default, user.id=0cdd881142fc452aa383e6193f9f4daa) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:13.617596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada9426-9553-48dd-ad99-75de8266f963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:13.619046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada9426-9553-48dd-ad99-75de8266f963 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:13.629352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Aug 22 19:39:13 2022] GET /identity/v3/role_assignments?user.id=0cdd881142fc452aa383e6193f9f4daa&scope.domain.id=default&role.id=9ec7f759c0a64655b794dfb597930076 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:13.652760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3274cc9-4a4b-4900-888d-ab105595fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:13.653415 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274cc9-4a4b-4900-888d-ab105595fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:13.653699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274cc9-4a4b-4900-888d-ab105595fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:13.653973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274cc9-4a4b-4900-888d-ab105595fcc2 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:13.654654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3274cc9-4a4b-4900-888d-ab105595fcc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:13.654959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3274cc9-4a4b-4900-888d-ab105595fcc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:13.656612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3274cc9-4a4b-4900-888d-ab105595fcc2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:13.678748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:15.671497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e625d51-08ea-4f66-a7c0-45023ba58e8c None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:15.671994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e625d51-08ea-4f66-a7c0-45023ba58e8c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:15.671994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e625d51-08ea-4f66-a7c0-45023ba58e8c None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:15.673294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:15.679554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedd0d2-d7d7-43d2-b792-9e1aa7209bb8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:15.680046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedd0d2-d7d7-43d2-b792-9e1aa7209bb8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:15.680123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedd0d2-d7d7-43d2-b792-9e1aa7209bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:15.708771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6aedd0d2-d7d7-43d2-b792-9e1aa7209bb8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:15.710045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6aedd0d2-d7d7-43d2-b792-9e1aa7209bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:15.802478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:16.136479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44966228-d493-4e9a-a409-227d53ea1dbf None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:16.136864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44966228-d493-4e9a-a409-227d53ea1dbf None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:16.137038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44966228-d493-4e9a-a409-227d53ea1dbf None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:16.138384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:16.152300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e60e08-04f5-4e4e-8326-f749c2e62cb2 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:16.152610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e60e08-04f5-4e4e-8326-f749c2e62cb2 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:16.152860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e60e08-04f5-4e4e-8326-f749c2e62cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:16.174258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-19e60e08-04f5-4e4e-8326-f749c2e62cb2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:16.175495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-19e60e08-04f5-4e4e-8326-f749c2e62cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:16.236251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:16.268739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 12/25] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:16.425013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44966228-d493-4e9a-a409-227d53ea1dbf None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:16.495614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2d529-e1b6-4c8e-a4e5-5ccf0d06850c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:16.495957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2d529-e1b6-4c8e-a4e5-5ccf0d06850c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:16.496179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2d529-e1b6-4c8e-a4e5-5ccf0d06850c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:16.497741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 13/26] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:16.519525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc2224-f6a7-4afe-9f74-9e1237aca43b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:16.519836 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc2224-f6a7-4afe-9f74-9e1237aca43b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:16.520081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc2224-f6a7-4afe-9f74-9e1237aca43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:16.552513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-bdbc2224-f6a7-4afe-9f74-9e1237aca43b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:16.554514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bdbc2224-f6a7-4afe-9f74-9e1237aca43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:16.616488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44966228-d493-4e9a-a409-227d53ea1dbf None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:16.678958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989b40e-4cc4-4920-9bc6-4ef1a0991369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:16.679711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989b40e-4cc4-4920-9bc6-4ef1a0991369 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:16.679990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989b40e-4cc4-4920-9bc6-4ef1a0991369 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:16.680258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989b40e-4cc4-4920-9bc6-4ef1a0991369 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:16.705471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989b40e-4cc4-4920-9bc6-4ef1a0991369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-b989b40e-4cc4-4920-9bc6-4ef1a0991369 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:16.710927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:16.711864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:16.712642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 14/27] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:39:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:16.713313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1b4f-82d4-41dc-8904-58c0b614ea74 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:16.714274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1b4f-82d4-41dc-8904-58c0b614ea74 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:16.714274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1b4f-82d4-41dc-8904-58c0b614ea74 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:16.721496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 15/28] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:16.721496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1b4f-82d4-41dc-8904-58c0b614ea74 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:16.726639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 14/29] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:16.727749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:16.728803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c46cd-d0ce-4dd9-a8e5-4e81cd4b6ad1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:16.729251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c46cd-d0ce-4dd9-a8e5-4e81cd4b6ad1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:16.729655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c46cd-d0ce-4dd9-a8e5-4e81cd4b6ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:16.748687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-632c46cd-d0ce-4dd9-a8e5-4e81cd4b6ad1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:16.750251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-632c46cd-d0ce-4dd9-a8e5-4e81cd4b6ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:16.838876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 15/30] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:16.843704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c46cd-d0ce-4dd9-a8e5-4e81cd4b6ad1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:16.879976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1b4f-82d4-41dc-8904-58c0b614ea74 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:16.895831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:16.966484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564a95-0d24-423e-8060-bc0f3497c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:16.975468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564a95-0d24-423e-8060-bc0f3497c45a None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:16.976376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564a95-0d24-423e-8060-bc0f3497c45a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:16.976858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564a95-0d24-423e-8060-bc0f3497c45a None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:16.977772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69564a95-0d24-423e-8060-bc0f3497c45a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:16.979493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69564a95-0d24-423e-8060-bc0f3497c45a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:17.044936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c46cd-d0ce-4dd9-a8e5-4e81cd4b6ad1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:17.087505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b4258-4d04-4a9e-bd7c-8e1b6f342fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:17.088192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b4258-4d04-4a9e-bd7c-8e1b6f342fc9 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:17.088529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b4258-4d04-4a9e-bd7c-8e1b6f342fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:17.088874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b4258-4d04-4a9e-bd7c-8e1b6f342fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:17.089711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b4258-4d04-4a9e-bd7c-8e1b6f342fc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:17.090051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b4258-4d04-4a9e-bd7c-8e1b6f342fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:17.091582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b4258-4d04-4a9e-bd7c-8e1b6f342fc9 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:17.107731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 16/31] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:17.113618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b4258-4d04-4a9e-bd7c-8e1b6f342fc9 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:17.241308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 16/32] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 19:39:16 2022] POST /identity/v3/roles => generated 219 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:17.242690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564a95-0d24-423e-8060-bc0f3497c45a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:17.295618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:17.304656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b4258-4d04-4a9e-bd7c-8e1b6f342fc9 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:17.381960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06372b2d-9b4b-4677-8fc8-d4de37dffa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:17.385013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06372b2d-9b4b-4677-8fc8-d4de37dffa0d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:17.386382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06372b2d-9b4b-4677-8fc8-d4de37dffa0d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:17.387038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06372b2d-9b4b-4677-8fc8-d4de37dffa0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:17.412724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:17.422190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06372b2d-9b4b-4677-8fc8-d4de37dffa0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:17.425041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06372b2d-9b4b-4677-8fc8-d4de37dffa0d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-06372b2d-9b4b-4677-8fc8-d4de37dffa0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:39:17.454241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:17.455153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:39:17.456015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:39:17.456015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:39:17.456015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:17.458027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 17/33] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:17.459043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06372b2d-9b4b-4677-8fc8-d4de37dffa0d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:17.474333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564a95-0d24-423e-8060-bc0f3497c45a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:17.522618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685a85-ec29-49f6-b756-a2e67dca210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:17.523183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685a85-ec29-49f6-b756-a2e67dca210f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:17.523506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685a85-ec29-49f6-b756-a2e67dca210f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:17.523765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79685a85-ec29-49f6-b756-a2e67dca210f None admin] PATH_INFO: `/v3/users/0cdd881142fc452aa383e6193f9f4daa` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:17.526587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685a85-ec29-49f6-b756-a2e67dca210f None admin] RBAC: Authorizing `identity:get_user(user_id=0cdd881142fc452aa383e6193f9f4daa)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:17.528319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79685a85-ec29-49f6-b756-a2e67dca210f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:17.530306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:17 2022] GET /identity/v3/users/0cdd881142fc452aa383e6193f9f4daa => generated 247 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:17.530982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685a85-ec29-49f6-b756-a2e67dca210f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:17.590790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06372b2d-9b4b-4677-8fc8-d4de37dffa0d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:17.629670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e67cf1-1425-4b3f-b7db-798634d5940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:17.630723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e67cf1-1425-4b3f-b7db-798634d5940b None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:17.631916 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e67cf1-1425-4b3f-b7db-798634d5940b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:17.632526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e67cf1-1425-4b3f-b7db-798634d5940b None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:17.633799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e67cf1-1425-4b3f-b7db-798634d5940b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:17.635559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e67cf1-1425-4b3f-b7db-798634d5940b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:17.653022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79685a85-ec29-49f6-b756-a2e67dca210f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:17.686235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:17.691197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37477157-56d7-43be-b53c-e15a67e336b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:17.691852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37477157-56d7-43be-b53c-e15a67e336b3 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:17.692134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37477157-56d7-43be-b53c-e15a67e336b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:17.692408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37477157-56d7-43be-b53c-e15a67e336b3 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:17.693071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37477157-56d7-43be-b53c-e15a67e336b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:17.693379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37477157-56d7-43be-b53c-e15a67e336b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:17.695287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37477157-56d7-43be-b53c-e15a67e336b3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:17.713669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 18/35] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:17.714833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9725-ddcb-4f75-b2e8-623e665657b0 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:17.715123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9725-ddcb-4f75-b2e8-623e665657b0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:17.715432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af9725-ddcb-4f75-b2e8-623e665657b0 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:17.716896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:17.717518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9725-ddcb-4f75-b2e8-623e665657b0 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:17.831409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af9725-ddcb-4f75-b2e8-623e665657b0 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:17.854319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 19:39:17 2022] POST /identity/v3/roles => generated 225 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:17.860534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e67cf1-1425-4b3f-b7db-798634d5940b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:17.878387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee880-132c-42b5-b6da-e39b3b5a71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:17.879058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee880-132c-42b5-b6da-e39b3b5a71d0 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:17.879384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee880-132c-42b5-b6da-e39b3b5a71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:17.879659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee880-132c-42b5-b6da-e39b3b5a71d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:17.882026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee880-132c-42b5-b6da-e39b3b5a71d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:17.884434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee880-132c-42b5-b6da-e39b3b5a71d0 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:17.885805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:17.888060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:17.889667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e51c70-b735-44b7-bd8a-6c4cb2594563 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:17.889950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e51c70-b735-44b7-bd8a-6c4cb2594563 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:17.890221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e51c70-b735-44b7-bd8a-6c4cb2594563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:17.917589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-00e51c70-b735-44b7-bd8a-6c4cb2594563 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:17.919267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-00e51c70-b735-44b7-bd8a-6c4cb2594563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:17.999754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:18.004874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e67cf1-1425-4b3f-b7db-798634d5940b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:18.014399 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 21/39] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:18.014957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e51c70-b735-44b7-bd8a-6c4cb2594563 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:18.050797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13563b17-af2d-48b2-8895-01ec23efe598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:18.051630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563b17-af2d-48b2-8895-01ec23efe598 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:18.051917 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563b17-af2d-48b2-8895-01ec23efe598 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:18.052190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563b17-af2d-48b2-8895-01ec23efe598 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:18.053678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13563b17-af2d-48b2-8895-01ec23efe598 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:18.055477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13563b17-af2d-48b2-8895-01ec23efe598 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:18.147785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e51c70-b735-44b7-bd8a-6c4cb2594563 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:18.172480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 19/40] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:39:17 2022] POST /identity/v3/projects => generated 301 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:18.173979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7ea8d-900d-4ac4-a6b0-4997316c6aa0 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:18.180150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7ea8d-900d-4ac4-a6b0-4997316c6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:18.180150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7ea8d-900d-4ac4-a6b0-4997316c6aa0 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:18.180150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 20/41] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:18.182323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa158b-c9f1-4d57-92e7-e160440619fc None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:18.182836 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa158b-c9f1-4d57-92e7-e160440619fc None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:18.183118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa158b-c9f1-4d57-92e7-e160440619fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:18.190148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d11a61-fc2d-4bb9-890f-6fb506e8e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:18.191176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d11a61-fc2d-4bb9-890f-6fb506e8e807 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:18.191706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d11a61-fc2d-4bb9-890f-6fb506e8e807 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:18.192154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d11a61-fc2d-4bb9-890f-6fb506e8e807 None admin] PATH_INFO: `/v3/domains/default/users/0cdd881142fc452aa383e6193f9f4daa/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:18.196796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d11a61-fc2d-4bb9-890f-6fb506e8e807 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0cdd881142fc452aa383e6193f9f4daa, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:18.198907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d11a61-fc2d-4bb9-890f-6fb506e8e807 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:18.205140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-65aa158b-c9f1-4d57-92e7-e160440619fc None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:18.206950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-65aa158b-c9f1-4d57-92e7-e160440619fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:18.283145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1361 bytes} [Mon Aug 22 19:39:18 2022] PUT /identity/v3/domains/default/users/0cdd881142fc452aa383e6193f9f4daa/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:39:18.289550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:18.304022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d11a61-fc2d-4bb9-890f-6fb506e8e807 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:18.304279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:18.370381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:18.562041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d11a61-fc2d-4bb9-890f-6fb506e8e807 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:18.582417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa158b-c9f1-4d57-92e7-e160440619fc None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:18.604843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02feeac-9c13-4adf-97cd-63ff3d9d9e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:18.605550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02feeac-9c13-4adf-97cd-63ff3d9d9e8e None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:18.606031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02feeac-9c13-4adf-97cd-63ff3d9d9e8e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:18.606505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02feeac-9c13-4adf-97cd-63ff3d9d9e8e None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:18.607780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02feeac-9c13-4adf-97cd-63ff3d9d9e8e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:18.609778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02feeac-9c13-4adf-97cd-63ff3d9d9e8e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:18.684862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 19:39:18 2022] POST /identity/v3/roles => generated 223 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:39:18.703903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa158b-c9f1-4d57-92e7-e160440619fc None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:18.745256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd038982-c5ae-468a-8f33-826e8006ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:18.745922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd038982-c5ae-468a-8f33-826e8006ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:18.746198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd038982-c5ae-468a-8f33-826e8006ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:18.746472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd038982-c5ae-468a-8f33-826e8006ecb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:18.747720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd038982-c5ae-468a-8f33-826e8006ecb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:18.749254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd038982-c5ae-468a-8f33-826e8006ecb4 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:18.751254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 22/45] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:18.757343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02feeac-9c13-4adf-97cd-63ff3d9d9e8e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:18.884854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02feeac-9c13-4adf-97cd-63ff3d9d9e8e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:18.897432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:18.930019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033966-1048-410b-8990-a956fbeac2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:18.930834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033966-1048-410b-8990-a956fbeac2fe None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:18.931354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033966-1048-410b-8990-a956fbeac2fe None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:18.931632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033966-1048-410b-8990-a956fbeac2fe None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:18.932299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f033966-1048-410b-8990-a956fbeac2fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:18.933775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f033966-1048-410b-8990-a956fbeac2fe None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:19.035188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:39:18 2022] POST /identity/v3/projects => generated 312 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:20.262025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae516-5e0b-4813-a6c2-0acee2fdd298 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:20.262544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae516-5e0b-4813-a6c2-0acee2fdd298 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:20.262627 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae516-5e0b-4813-a6c2-0acee2fdd298 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:20.264082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:20.269695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a92d-5917-4152-883e-92a49dab669f None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:20.270149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a92d-5917-4152-883e-92a49dab669f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:20.270253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a92d-5917-4152-883e-92a49dab669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:20.288592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-36a7a92d-5917-4152-883e-92a49dab669f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:20.289825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-36a7a92d-5917-4152-883e-92a49dab669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:20.359186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:20.628641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae516-5e0b-4813-a6c2-0acee2fdd298 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:20.692353 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:20.736042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae516-5e0b-4813-a6c2-0acee2fdd298 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:20.771792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfaaed-3e30-4517-ae3e-1f196a802a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:20.772425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfaaed-3e30-4517-ae3e-1f196a802a2b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:20.772702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfaaed-3e30-4517-ae3e-1f196a802a2b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:20.772974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfaaed-3e30-4517-ae3e-1f196a802a2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:20.787546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfaaed-3e30-4517-ae3e-1f196a802a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-98dfaaed-3e30-4517-ae3e-1f196a802a2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:20.793501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:20.794386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:20.795126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 24/49] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:20.800475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7a92d-5917-4152-883e-92a49dab669f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:20.895963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:20.905059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7a92d-5917-4152-883e-92a49dab669f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:20.940575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4065561-4dfe-4051-96c2-3df831da2fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:20.941194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065561-4dfe-4051-96c2-3df831da2fb3 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:20.941473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065561-4dfe-4051-96c2-3df831da2fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:20.941746 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4065561-4dfe-4051-96c2-3df831da2fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:20.942430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4065561-4dfe-4051-96c2-3df831da2fb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:20.942732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4065561-4dfe-4051-96c2-3df831da2fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:20.944901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4065561-4dfe-4051-96c2-3df831da2fb3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:20.953680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 26/50] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:20.959317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfaaed-3e30-4517-ae3e-1f196a802a2b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:21.030238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1efe9-52e7-4d11-a1fb-e14bc53c1736 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:21.030527 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1efe9-52e7-4d11-a1fb-e14bc53c1736 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:21.030797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1efe9-52e7-4d11-a1fb-e14bc53c1736 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:21.032193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 27/51] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:21.037508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2e63-17d4-40df-a57b-54c498497511 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:21.037864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2e63-17d4-40df-a57b-54c498497511 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:21.038144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2e63-17d4-40df-a57b-54c498497511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:21.056485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9a9a2e63-17d4-40df-a57b-54c498497511 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:21.057700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9a9a2e63-17d4-40df-a57b-54c498497511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:21.064085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfaaed-3e30-4517-ae3e-1f196a802a2b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:21.084951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:21.098784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50b22-1da4-4b45-ab3a-9aa334054183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:21.099462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50b22-1da4-4b45-ab3a-9aa334054183 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:21.099763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50b22-1da4-4b45-ab3a-9aa334054183 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:21.100042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50b22-1da4-4b45-ab3a-9aa334054183 None admin] PATH_INFO: `/v3/users/0cdd881142fc452aa383e6193f9f4daa` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:21.101569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50b22-1da4-4b45-ab3a-9aa334054183 None admin] RBAC: Authorizing `identity:get_user(user_id=0cdd881142fc452aa383e6193f9f4daa)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:21.103041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50b22-1da4-4b45-ab3a-9aa334054183 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:21.104698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 25/52] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:20 2022] GET /identity/v3/users/0cdd881142fc452aa383e6193f9f4daa => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:21.110270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50b22-1da4-4b45-ab3a-9aa334054183 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:21.133719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 28/53] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:21.328076 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50b22-1da4-4b45-ab3a-9aa334054183 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:21.366959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8934f15-ead2-47cc-a588-14395b0786a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:21.367624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8934f15-ead2-47cc-a588-14395b0786a9 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:21.367905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8934f15-ead2-47cc-a588-14395b0786a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:21.368173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8934f15-ead2-47cc-a588-14395b0786a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:21.369304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8934f15-ead2-47cc-a588-14395b0786a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:21.370762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8934f15-ead2-47cc-a588-14395b0786a9 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:21.372374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 26/54] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:21.378192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a2e63-17d4-40df-a57b-54c498497511 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:21.403041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8934f15-ead2-47cc-a588-14395b0786a9 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:21.461480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:21.478707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:21.496211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a2e63-17d4-40df-a57b-54c498497511 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:21.505542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8934f15-ead2-47cc-a588-14395b0786a9 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:21.532952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3b610-45a6-41cb-81d1-2675b48d3035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:21.533555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3b610-45a6-41cb-81d1-2675b48d3035 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:21.536010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3b610-45a6-41cb-81d1-2675b48d3035 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:21.536010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3b610-45a6-41cb-81d1-2675b48d3035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:21.536010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3b610-45a6-41cb-81d1-2675b48d3035 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.domain.id=default, user.id=0cdd881142fc452aa383e6193f9f4daa) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:21.536010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3b610-45a6-41cb-81d1-2675b48d3035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:21.536713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3b610-45a6-41cb-81d1-2675b48d3035 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:21.543612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 29/55] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Aug 22 19:39:21 2022] GET /identity/v3/role_assignments?user.id=0cdd881142fc452aa383e6193f9f4daa&scope.domain.id=default&role.id=9ec7f759c0a64655b794dfb597930076 => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:21.546833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9872f6-ede1-4986-b5e5-d252f6e6edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:21.547510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9872f6-ede1-4986-b5e5-d252f6e6edc5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:21.547796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9872f6-ede1-4986-b5e5-d252f6e6edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:21.548082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9872f6-ede1-4986-b5e5-d252f6e6edc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:21.549433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9872f6-ede1-4986-b5e5-d252f6e6edc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:21.550995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9872f6-ede1-4986-b5e5-d252f6e6edc5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:21.552728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 27/56] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:21.559307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3b610-45a6-41cb-81d1-2675b48d3035 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:21.672702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3b610-45a6-41cb-81d1-2675b48d3035 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:21.710597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f484-ef32-4d49-9c58-1e6dd9600b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:21.711215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f484-ef32-4d49-9c58-1e6dd9600b58 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:21.711586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f484-ef32-4d49-9c58-1e6dd9600b58 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:21.711861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f484-ef32-4d49-9c58-1e6dd9600b58 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:21.712529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f484-ef32-4d49-9c58-1e6dd9600b58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:21.713986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f484-ef32-4d49-9c58-1e6dd9600b58 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:21.795241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:21.801056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 30/57] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Aug 22 19:39:21 2022] POST /identity/v3/projects => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:23.733676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291f5c-de60-43f0-af05-28c148472ff1 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:23.734208 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291f5c-de60-43f0-af05-28c148472ff1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:23.734208 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291f5c-de60-43f0-af05-28c148472ff1 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:23.735619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 28/58] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:23.740778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ee004-e030-4044-9539-5c906fb7c4d8 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:23.741148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ee004-e030-4044-9539-5c906fb7c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:23.741324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ee004-e030-4044-9539-5c906fb7c4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:23.759982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-3a7ee004-e030-4044-9539-5c906fb7c4d8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:23.761197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3a7ee004-e030-4044-9539-5c906fb7c4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:23.828460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 31/59] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:24.103663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291f5c-de60-43f0-af05-28c148472ff1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:24.206505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291f5c-de60-43f0-af05-28c148472ff1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:24.230559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:24.241807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b50ba9-9792-4f63-be5a-9c3e774bdd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:24.242442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b50ba9-9792-4f63-be5a-9c3e774bdd34 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:24.242719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b50ba9-9792-4f63-be5a-9c3e774bdd34 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:24.244098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b50ba9-9792-4f63-be5a-9c3e774bdd34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:24.244212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b50ba9-9792-4f63-be5a-9c3e774bdd34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:24.245656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b50ba9-9792-4f63-be5a-9c3e774bdd34 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:24.247242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 29/60] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:24.253134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ee004-e030-4044-9539-5c906fb7c4d8 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:24.358848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ee004-e030-4044-9539-5c906fb7c4d8 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:24.389145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:24.395141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee366cd-a9ce-4b03-8c51-047e7bac77ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:24.395891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee366cd-a9ce-4b03-8c51-047e7bac77ba None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:24.396062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee366cd-a9ce-4b03-8c51-047e7bac77ba None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:24.396340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee366cd-a9ce-4b03-8c51-047e7bac77ba None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:24.397431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee366cd-a9ce-4b03-8c51-047e7bac77ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:24.398933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee366cd-a9ce-4b03-8c51-047e7bac77ba None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:24.507124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 32/61] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:39:24 2022] POST /identity/v3/users => generated 275 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:27.531317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba9e83-c1c7-4586-a714-a069e825247e None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:27.531817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba9e83-c1c7-4586-a714-a069e825247e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:27.531887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba9e83-c1c7-4586-a714-a069e825247e None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:27.533205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 30/62] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:27.538982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14817a-7016-40ee-8d0d-337c1bd19878 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:27.539486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14817a-7016-40ee-8d0d-337c1bd19878 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:27.539574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14817a-7016-40ee-8d0d-337c1bd19878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:27.569231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-df14817a-7016-40ee-8d0d-337c1bd19878 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:27.571181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-df14817a-7016-40ee-8d0d-337c1bd19878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:27.710777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 33/63] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:27.738649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d99f6-c8a5-4669-a38a-8aae5f80e2b8 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:27.739305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d99f6-c8a5-4669-a38a-8aae5f80e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:27.739793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d99f6-c8a5-4669-a38a-8aae5f80e2b8 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:27.742149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 31/64] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:27.748056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8963a-35da-48ab-b3b1-3f1f63278a70 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:27.748404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8963a-35da-48ab-b3b1-3f1f63278a70 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:27.748695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8963a-35da-48ab-b3b1-3f1f63278a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:27.770355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-69c8963a-35da-48ab-b3b1-3f1f63278a70 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:27.772215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-69c8963a-35da-48ab-b3b1-3f1f63278a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:27.866069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 34/65] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:27.905731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be853100-3f3f-4cfc-927a-3b1259c295cb None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:27.906334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be853100-3f3f-4cfc-927a-3b1259c295cb None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:27.906821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be853100-3f3f-4cfc-927a-3b1259c295cb None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:27.908669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 32/66] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:27.914758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95711bbb-10e5-4942-b487-a9e6ceda35bf None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:27.915034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95711bbb-10e5-4942-b487-a9e6ceda35bf None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:27.915346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95711bbb-10e5-4942-b487-a9e6ceda35bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:27.925709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8674e25-28b0-475a-ba69-af98acb0c012 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:27.926322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8674e25-28b0-475a-ba69-af98acb0c012 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:27.926790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8674e25-28b0-475a-ba69-af98acb0c012 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:27.928610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 33/67] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:27.934197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298bcf8-8b71-448b-a032-229190dd67fe None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:27.934756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298bcf8-8b71-448b-a032-229190dd67fe None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:27.934873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-95711bbb-10e5-4942-b487-a9e6ceda35bf None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:27.935398 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298bcf8-8b71-448b-a032-229190dd67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:27.936077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-95711bbb-10e5-4942-b487-a9e6ceda35bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:27.955368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b298bcf8-8b71-448b-a032-229190dd67fe None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:27.957109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b298bcf8-8b71-448b-a032-229190dd67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:28.006327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:28.041652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 34/68] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:28.062878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 35/69] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:28.125971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298bcf8-8b71-448b-a032-229190dd67fe None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:28.182126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95711bbb-10e5-4942-b487-a9e6ceda35bf None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:28.252142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298bcf8-8b71-448b-a032-229190dd67fe None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:28.279002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:28.301534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65dc7-7eb8-4bc6-9cce-ad2a8f8bfcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:28.302597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65dc7-7eb8-4bc6-9cce-ad2a8f8bfcc5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.303084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65dc7-7eb8-4bc6-9cce-ad2a8f8bfcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.303587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac65dc7-7eb8-4bc6-9cce-ad2a8f8bfcc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.323143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac65dc7-7eb8-4bc6-9cce-ad2a8f8bfcc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:28.324869 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95711bbb-10e5-4942-b487-a9e6ceda35bf None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-6ac65dc7-7eb8-4bc6-9cce-ad2a8f8bfcc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:28.334703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:28.342285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 35/70] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:28.343059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65dc7-7eb8-4bc6-9cce-ad2a8f8bfcc5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:28.377154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c3df9-f81c-4c67-b3aa-b726c7ceb045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:28.377907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c3df9-f81c-4c67-b3aa-b726c7ceb045 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.378200 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c3df9-f81c-4c67-b3aa-b726c7ceb045 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.378478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c3df9-f81c-4c67-b3aa-b726c7ceb045 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.391662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c3df9-f81c-4c67-b3aa-b726c7ceb045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-603c3df9-f81c-4c67-b3aa-b726c7ceb045 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:28.398898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:28.399933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:28.400679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:28.407262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2b1c4-5138-42bb-b859-4c7b766e97a5 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.407262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2b1c4-5138-42bb-b859-4c7b766e97a5 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.407262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2b1c4-5138-42bb-b859-4c7b766e97a5 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.407551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 37/72] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:28.413320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2b1c4-5138-42bb-b859-4c7b766e97a5 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:28.462548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:28.476192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac65dc7-7eb8-4bc6-9cce-ad2a8f8bfcc5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:28.512785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c87c48-730b-479e-8bf0-3e7e5b7d18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:28.513404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87c48-730b-479e-8bf0-3e7e5b7d18c5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.513685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87c48-730b-479e-8bf0-3e7e5b7d18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.513960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c87c48-730b-479e-8bf0-3e7e5b7d18c5 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.514646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c87c48-730b-479e-8bf0-3e7e5b7d18c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:28.514948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c87c48-730b-479e-8bf0-3e7e5b7d18c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:28.516880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c87c48-730b-479e-8bf0-3e7e5b7d18c5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:28.526279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:28.528583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0112f7-df77-454b-9474-1d4626ecb30e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.528875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0112f7-df77-454b-9474-1d4626ecb30e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.529236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0112f7-df77-454b-9474-1d4626ecb30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.531968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2b1c4-5138-42bb-b859-4c7b766e97a5 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:28.547527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-cf0112f7-df77-454b-9474-1d4626ecb30e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:28.548736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cf0112f7-df77-454b-9474-1d4626ecb30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:28.568813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24559d0-54ee-4ef0-9ef5-68c2f0ffd352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:28.569530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24559d0-54ee-4ef0-9ef5-68c2f0ffd352 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.569810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24559d0-54ee-4ef0-9ef5-68c2f0ffd352 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.570079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24559d0-54ee-4ef0-9ef5-68c2f0ffd352 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.571335 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24559d0-54ee-4ef0-9ef5-68c2f0ffd352 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:28.571646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24559d0-54ee-4ef0-9ef5-68c2f0ffd352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:28.573336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24559d0-54ee-4ef0-9ef5-68c2f0ffd352 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:28.588351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 38/74] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:28.589291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24559d0-54ee-4ef0-9ef5-68c2f0ffd352 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:28.593103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:28.620551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 37/75] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:28.621575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0112f7-df77-454b-9474-1d4626ecb30e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:28.701584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:28.705814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24559d0-54ee-4ef0-9ef5-68c2f0ffd352 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:28.743738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed6cc6-3bef-4fd6-be1b-a4f82614410d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:28.744391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed6cc6-3bef-4fd6-be1b-a4f82614410d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.744677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed6cc6-3bef-4fd6-be1b-a4f82614410d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.744955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed6cc6-3bef-4fd6-be1b-a4f82614410d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.751058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0112f7-df77-454b-9474-1d4626ecb30e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:28.759318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed6cc6-3bef-4fd6-be1b-a4f82614410d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-e9ed6cc6-3bef-4fd6-be1b-a4f82614410d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:28.764208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:28.765052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:28.765835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:28.766490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed6cc6-3bef-4fd6-be1b-a4f82614410d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:28.793699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e46686-c63e-408c-bd1f-b1cab7750146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:28.794266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e46686-c63e-408c-bd1f-b1cab7750146 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.794858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e46686-c63e-408c-bd1f-b1cab7750146 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.794858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e46686-c63e-408c-bd1f-b1cab7750146 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.812192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e46686-c63e-408c-bd1f-b1cab7750146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-80e46686-c63e-408c-bd1f-b1cab7750146 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:28.818915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:28.819902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:28.820659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 38/77] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:28.821277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e46686-c63e-408c-bd1f-b1cab7750146 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:28.858483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:28.895201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed6cc6-3bef-4fd6-be1b-a4f82614410d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:28.932406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b95d5-19a4-4601-9b52-d99ed4ad8d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:28.932894 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e46686-c63e-408c-bd1f-b1cab7750146 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:28.933044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b95d5-19a4-4601-9b52-d99ed4ad8d15 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.933325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b95d5-19a4-4601-9b52-d99ed4ad8d15 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.933599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b95d5-19a4-4601-9b52-d99ed4ad8d15 None admin] PATH_INFO: `/v3/users/794a16f8475e4a71ad739f9516b9f0b7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.949991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b95d5-19a4-4601-9b52-d99ed4ad8d15 None admin] RBAC: Authorizing `identity:get_user(user_id=794a16f8475e4a71ad739f9516b9f0b7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:28.951525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b95d5-19a4-4601-9b52-d99ed4ad8d15 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:28.953217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 40/78] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/users/794a16f8475e4a71ad739f9516b9f0b7 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:28.954075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b95d5-19a4-4601-9b52-d99ed4ad8d15 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:28.972782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590836bf-5ea0-429d-8fc4-fc9082a909d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:28.973422 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590836bf-5ea0-429d-8fc4-fc9082a909d0 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:28.973703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590836bf-5ea0-429d-8fc4-fc9082a909d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:28.973978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590836bf-5ea0-429d-8fc4-fc9082a909d0 None admin] PATH_INFO: `/v3/users/794a16f8475e4a71ad739f9516b9f0b7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:28.976111 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590836bf-5ea0-429d-8fc4-fc9082a909d0 None admin] RBAC: Authorizing `identity:get_user(user_id=794a16f8475e4a71ad739f9516b9f0b7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:28.976875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590836bf-5ea0-429d-8fc4-fc9082a909d0 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:28.978510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 39/79] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/users/794a16f8475e4a71ad739f9516b9f0b7 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:28.983715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:28.983807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590836bf-5ea0-429d-8fc4-fc9082a909d0 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:29.082351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b95d5-19a4-4601-9b52-d99ed4ad8d15 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:29.082736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590836bf-5ea0-429d-8fc4-fc9082a909d0 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:29.085165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:29.123453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4088f88-6564-4e8a-8f51-3056cf7c8ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:29.123671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce7bf5-40eb-4bb2-9b75-98ddb051158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:29.124073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4088f88-6564-4e8a-8f51-3056cf7c8ba1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:29.124166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce7bf5-40eb-4bb2-9b75-98ddb051158f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:29.124433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce7bf5-40eb-4bb2-9b75-98ddb051158f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:29.124515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4088f88-6564-4e8a-8f51-3056cf7c8ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:29.124709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce7bf5-40eb-4bb2-9b75-98ddb051158f None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:29.124791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4088f88-6564-4e8a-8f51-3056cf7c8ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:29.125400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce7bf5-40eb-4bb2-9b75-98ddb051158f None admin] RBAC: Adding query filter params (name=member) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:29.125483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4088f88-6564-4e8a-8f51-3056cf7c8ba1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:29.125703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4088f88-6564-4e8a-8f51-3056cf7c8ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:29.125784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce7bf5-40eb-4bb2-9b75-98ddb051158f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:29.127118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4088f88-6564-4e8a-8f51-3056cf7c8ba1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:29.127216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce7bf5-40eb-4bb2-9b75-98ddb051158f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:29.137400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 41/81] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:29.137609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 40/81] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:29.138266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4088f88-6564-4e8a-8f51-3056cf7c8ba1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:29.138808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce7bf5-40eb-4bb2-9b75-98ddb051158f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:29.229108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:29.246416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce7bf5-40eb-4bb2-9b75-98ddb051158f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:29.254671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4088f88-6564-4e8a-8f51-3056cf7c8ba1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:29.282405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04eede-203a-434f-84bd-31060767c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:29.283025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04eede-203a-434f-84bd-31060767c57c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:29.283333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04eede-203a-434f-84bd-31060767c57c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:29.283673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04eede-203a-434f-84bd-31060767c57c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:29.292274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372a628-f85d-40cc-871f-1409c86246b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:29.292925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372a628-f85d-40cc-871f-1409c86246b9 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:29.293212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372a628-f85d-40cc-871f-1409c86246b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:29.293493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372a628-f85d-40cc-871f-1409c86246b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:29.294631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372a628-f85d-40cc-871f-1409c86246b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:29.296181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372a628-f85d-40cc-871f-1409c86246b9 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:29.297787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 42/82] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:29.299755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372a628-f85d-40cc-871f-1409c86246b9 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:29.317337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:29.358966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04eede-203a-434f-84bd-31060767c57c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:29.360780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04eede-203a-434f-84bd-31060767c57c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:29.415203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372a628-f85d-40cc-871f-1409c86246b9 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:29.450107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c0f5f-9126-4d7d-bafb-e83db777db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:29.450720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c0f5f-9126-4d7d-bafb-e83db777db25 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:29.451000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c0f5f-9126-4d7d-bafb-e83db777db25 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:29.451303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c0f5f-9126-4d7d-bafb-e83db777db25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:29.467666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:29.473379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 41/83] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:29.474933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04eede-203a-434f-84bd-31060767c57c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:29.525373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c0f5f-9126-4d7d-bafb-e83db777db25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:29.526864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c0f5f-9126-4d7d-bafb-e83db777db25 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:29.545550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:29.589160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04eede-203a-434f-84bd-31060767c57c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:29.625605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bedfc-c44b-4926-96c1-ab45d7730f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:29.626158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bedfc-c44b-4926-96c1-ab45d7730f87 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:29.626453 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bedfc-c44b-4926-96c1-ab45d7730f87 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:29.626727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bedfc-c44b-4926-96c1-ab45d7730f87 None admin] PATH_INFO: `/v3/users/794a16f8475e4a71ad739f9516b9f0b7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:29.627897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bedfc-c44b-4926-96c1-ab45d7730f87 None admin] RBAC: Authorizing `identity:get_user(user_id=794a16f8475e4a71ad739f9516b9f0b7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:29.629468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bedfc-c44b-4926-96c1-ab45d7730f87 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:29.631467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 42/84] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:29 2022] GET /identity/v3/users/794a16f8475e4a71ad739f9516b9f0b7 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:29.632162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bedfc-c44b-4926-96c1-ab45d7730f87 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:29.640803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 43/85] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:29.642191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c0f5f-9126-4d7d-bafb-e83db777db25 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:29.700291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:29.747428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bedfc-c44b-4926-96c1-ab45d7730f87 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:29.761343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c0f5f-9126-4d7d-bafb-e83db777db25 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:29.779964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:29.786783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c4ff0-e446-4863-98cd-ff3c0b235220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:29.787799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4ff0-e446-4863-98cd-ff3c0b235220 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:29.788130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4ff0-e446-4863-98cd-ff3c0b235220 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:29.788408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c4ff0-e446-4863-98cd-ff3c0b235220 None admin] PATH_INFO: `/v3/users/0cdd881142fc452aa383e6193f9f4daa` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:29.789601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c4ff0-e446-4863-98cd-ff3c0b235220 None admin] RBAC: Authorizing `identity:get_user(user_id=0cdd881142fc452aa383e6193f9f4daa)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:29.791088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c4ff0-e446-4863-98cd-ff3c0b235220 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:29.793228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 43/86] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:29 2022] GET /identity/v3/users/0cdd881142fc452aa383e6193f9f4daa => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:29.793534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c4ff0-e446-4863-98cd-ff3c0b235220 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:29.801043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1ffb2-8334-4d25-a186-21d92af44191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:29.804398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ffb2-8334-4d25-a186-21d92af44191 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:29.804398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ffb2-8334-4d25-a186-21d92af44191 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:29.804398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1ffb2-8334-4d25-a186-21d92af44191 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:29.804398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1ffb2-8334-4d25-a186-21d92af44191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:29.805006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1ffb2-8334-4d25-a186-21d92af44191 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:29.879064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 44/87] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:39:29 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:29.882216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1ffb2-8334-4d25-a186-21d92af44191 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:29.914098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c4ff0-e446-4863-98cd-ff3c0b235220 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:29.961858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3bae8-b9d7-48d1-b4b2-3b380315b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:29.962526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3bae8-b9d7-48d1-b4b2-3b380315b936 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:29.962816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3bae8-b9d7-48d1-b4b2-3b380315b936 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:29.963096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3bae8-b9d7-48d1-b4b2-3b380315b936 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:29.965242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3bae8-b9d7-48d1-b4b2-3b380315b936 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:29.966763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3bae8-b9d7-48d1-b4b2-3b380315b936 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:29.974111 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 44/88] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:29 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:29.974111 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3bae8-b9d7-48d1-b4b2-3b380315b936 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:30.038035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1ffb2-8334-4d25-a186-21d92af44191 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:30.039880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:30.061000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:30.086080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8818803-de69-44c8-a6f0-d045da1c2cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:30.086703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8818803-de69-44c8-a6f0-d045da1c2cfb None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:30.087156 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8818803-de69-44c8-a6f0-d045da1c2cfb None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:30.087441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8818803-de69-44c8-a6f0-d045da1c2cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:30.108101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3bae8-b9d7-48d1-b4b2-3b380315b936 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:30.156203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09ca0-8741-4e10-bf1a-1d4e6299b9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:30.156783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09ca0-8741-4e10-bf1a-1d4e6299b9ee None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:30.157082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09ca0-8741-4e10-bf1a-1d4e6299b9ee None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:30.157335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09ca0-8741-4e10-bf1a-1d4e6299b9ee None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:30.159328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e09ca0-8741-4e10-bf1a-1d4e6299b9ee None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:30.160986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e09ca0-8741-4e10-bf1a-1d4e6299b9ee None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:30.163705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 45/89] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:29 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:30.164463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09ca0-8741-4e10-bf1a-1d4e6299b9ee None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:30.186754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8818803-de69-44c8-a6f0-d045da1c2cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:30.188894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8818803-de69-44c8-a6f0-d045da1c2cfb None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:30.321064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09ca0-8741-4e10-bf1a-1d4e6299b9ee None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:30.336861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 45/90] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:30.337843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8818803-de69-44c8-a6f0-d045da1c2cfb None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:30.341202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:30.375608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1f1ed-37fa-4f5b-bbf5-2e52d41a2acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:30.376225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1f1ed-37fa-4f5b-bbf5-2e52d41a2acc None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:30.376502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1f1ed-37fa-4f5b-bbf5-2e52d41a2acc None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:30.376772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1f1ed-37fa-4f5b-bbf5-2e52d41a2acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:30.382908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:30.482611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1f1ed-37fa-4f5b-bbf5-2e52d41a2acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:30.484803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1f1ed-37fa-4f5b-bbf5-2e52d41a2acc None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:30.517372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8818803-de69-44c8-a6f0-d045da1c2cfb None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:30.567705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908a7cb-81b3-426e-b3d5-d46db3bf0330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:30.568976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908a7cb-81b3-426e-b3d5-d46db3bf0330 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:30.569254 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908a7cb-81b3-426e-b3d5-d46db3bf0330 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:30.571972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908a7cb-81b3-426e-b3d5-d46db3bf0330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:30.571972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908a7cb-81b3-426e-b3d5-d46db3bf0330 None admin] RBAC: Adding query filter params (role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=5b45f2debc7148b79ed609906b98b179, user.id=794a16f8475e4a71ad739f9516b9f0b7) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:30.571972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908a7cb-81b3-426e-b3d5-d46db3bf0330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:30.572237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908a7cb-81b3-426e-b3d5-d46db3bf0330 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:30.587269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:30 2022] GET /identity/v3/role_assignments?user.id=794a16f8475e4a71ad739f9516b9f0b7&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:30.587269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908a7cb-81b3-426e-b3d5-d46db3bf0330 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:30.695862 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 46/92] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:30.696890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1f1ed-37fa-4f5b-bbf5-2e52d41a2acc None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:30.754570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:30.765881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:30.825889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908a7cb-81b3-426e-b3d5-d46db3bf0330 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:30.868202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53e55a-28f2-441b-b4ab-928eb24eaf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:30.869236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53e55a-28f2-441b-b4ab-928eb24eaf5f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:30.869740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53e55a-28f2-441b-b4ab-928eb24eaf5f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:30.870255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53e55a-28f2-441b-b4ab-928eb24eaf5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:30.871257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53e55a-28f2-441b-b4ab-928eb24eaf5f None admin] RBAC: Adding query filter params (role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=5b45f2debc7148b79ed609906b98b179, user.id=794a16f8475e4a71ad739f9516b9f0b7) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:30.872850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53e55a-28f2-441b-b4ab-928eb24eaf5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:30.877108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53e55a-28f2-441b-b4ab-928eb24eaf5f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:30.891650 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 47/93] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:30 2022] GET /identity/v3/role_assignments?user.id=794a16f8475e4a71ad739f9516b9f0b7&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=25294da9af854bf181e95bc99a9818c8 => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:30.893603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53e55a-28f2-441b-b4ab-928eb24eaf5f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:30.920941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1f1ed-37fa-4f5b-bbf5-2e52d41a2acc None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:30.985388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5765117-f535-443e-8cf2-0ed363c1593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:30.986459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5765117-f535-443e-8cf2-0ed363c1593d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:30.987049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5765117-f535-443e-8cf2-0ed363c1593d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:30.987556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5765117-f535-443e-8cf2-0ed363c1593d None admin] PATH_INFO: `/v3/projects/2f29280910434b27914b2da39eba7c3b` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:30.989151 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5765117-f535-443e-8cf2-0ed363c1593d None admin] RBAC: Authorizing `identity:get_project(project_id=2f29280910434b27914b2da39eba7c3b)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:30.991070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5765117-f535-443e-8cf2-0ed363c1593d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:30.993203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:30 2022] GET /identity/v3/projects/2f29280910434b27914b2da39eba7c3b => generated 312 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:30.999756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5765117-f535-443e-8cf2-0ed363c1593d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:31.139251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5765117-f535-443e-8cf2-0ed363c1593d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:31.140565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53e55a-28f2-441b-b4ab-928eb24eaf5f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:31.142763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:31.179719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2587b-343c-4b8e-9c07-3922c3737d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:31.181833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2587b-343c-4b8e-9c07-3922c3737d3b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:31.182331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2587b-343c-4b8e-9c07-3922c3737d3b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:31.182806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2587b-343c-4b8e-9c07-3922c3737d3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:31.183874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2587b-343c-4b8e-9c07-3922c3737d3b None admin] RBAC: Adding query filter params (role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=2f29280910434b27914b2da39eba7c3b, user.id=794a16f8475e4a71ad739f9516b9f0b7) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:31.184437 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2587b-343c-4b8e-9c07-3922c3737d3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:31.186160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2587b-343c-4b8e-9c07-3922c3737d3b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:31.198063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:31.211264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d933-0dd2-4f28-8aa5-0fb6aea00f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:31.215888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d933-0dd2-4f28-8aa5-0fb6aea00f5b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:31.216375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d933-0dd2-4f28-8aa5-0fb6aea00f5b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:31.216880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d933-0dd2-4f28-8aa5-0fb6aea00f5b None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:31.218187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 48/95] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:30 2022] GET /identity/v3/role_assignments?user.id=794a16f8475e4a71ad739f9516b9f0b7&scope.project.id=2f29280910434b27914b2da39eba7c3b&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:31.219050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5d933-0dd2-4f28-8aa5-0fb6aea00f5b None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:31.220800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5d933-0dd2-4f28-8aa5-0fb6aea00f5b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:31.223125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:30 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:31.229089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2587b-343c-4b8e-9c07-3922c3737d3b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:31.378899 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2587b-343c-4b8e-9c07-3922c3737d3b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:31.419982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c68b13-e884-43ed-8d21-99a7b78746b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:31.420622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c68b13-e884-43ed-8d21-99a7b78746b9 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:31.420957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c68b13-e884-43ed-8d21-99a7b78746b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:31.421339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c68b13-e884-43ed-8d21-99a7b78746b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:31.422114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c68b13-e884-43ed-8d21-99a7b78746b9 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=5b45f2debc7148b79ed609906b98b179, user.id=0cdd881142fc452aa383e6193f9f4daa) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:31.422490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c68b13-e884-43ed-8d21-99a7b78746b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:31.424061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c68b13-e884-43ed-8d21-99a7b78746b9 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:31.431414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:31 2022] GET /identity/v3/role_assignments?user.id=0cdd881142fc452aa383e6193f9f4daa&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=9ec7f759c0a64655b794dfb597930076 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:32.452781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9b57-9501-47e6-885c-c868ba199ffa None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:32.453282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9b57-9501-47e6-885c-c868ba199ffa None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:32.453352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9b57-9501-47e6-885c-c868ba199ffa None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:32.454697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 49/98] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:32.461289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4410ea-3857-42af-b39e-5ae02890861f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:32.461841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4410ea-3857-42af-b39e-5ae02890861f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:32.461841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4410ea-3857-42af-b39e-5ae02890861f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:32.487513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-af4410ea-3857-42af-b39e-5ae02890861f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:32.489556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-af4410ea-3857-42af-b39e-5ae02890861f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:32.526572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:32.585660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 50/99] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:32.658952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5199b4-635b-478b-b522-4ed53ce0fe4e None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:32.659132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5199b4-635b-478b-b522-4ed53ce0fe4e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:32.659452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5199b4-635b-478b-b522-4ed53ce0fe4e None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:32.660823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 50/100] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:32.670075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a236ce-373f-4669-b9e3-795c48ca9488 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:32.670366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a236ce-373f-4669-b9e3-795c48ca9488 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:32.670638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a236ce-373f-4669-b9e3-795c48ca9488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:32.703014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-a1a236ce-373f-4669-b9e3-795c48ca9488 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:32.704278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a1a236ce-373f-4669-b9e3-795c48ca9488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:32.795408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 51/101] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:33.028801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5199b4-635b-478b-b522-4ed53ce0fe4e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:33.161533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5199b4-635b-478b-b522-4ed53ce0fe4e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:33.211154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b724a-153c-4872-bcf1-d361963e0a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:33.212201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b724a-153c-4872-bcf1-d361963e0a45 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:33.212689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b724a-153c-4872-bcf1-d361963e0a45 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:33.213159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b724a-153c-4872-bcf1-d361963e0a45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:33.220012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b724a-153c-4872-bcf1-d361963e0a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:33.221796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b724a-153c-4872-bcf1-d361963e0a45 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:33.223732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 51/102] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:33.230446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a236ce-373f-4669-b9e3-795c48ca9488 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:33.373192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:33.391005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a236ce-373f-4669-b9e3-795c48ca9488 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:33.431129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b724a-153c-4872-bcf1-d361963e0a45 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:33.475193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1684a-306f-486e-945a-349d3ef62768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:33.476645 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1684a-306f-486e-945a-349d3ef62768 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:33.477121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1684a-306f-486e-945a-349d3ef62768 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:33.477585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1684a-306f-486e-945a-349d3ef62768 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:33.478470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1684a-306f-486e-945a-349d3ef62768 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:33.480597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1684a-306f-486e-945a-349d3ef62768 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:33.554312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:33.588957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 52/103] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:39:33 2022] POST /identity/v3/projects => generated 302 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:33.591677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e2e6-430e-4a53-9c43-5a7fb5c54474 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:33.591958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e2e6-430e-4a53-9c43-5a7fb5c54474 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:33.592228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e2e6-430e-4a53-9c43-5a7fb5c54474 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:33.598208 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 53/104] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:33.605121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1fc25-30fd-4fc7-ba3f-c319f16972e9 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:33.606649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1fc25-30fd-4fc7-ba3f-c319f16972e9 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:33.607317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1fc25-30fd-4fc7-ba3f-c319f16972e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:33.635006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b724a-153c-4872-bcf1-d361963e0a45 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:33.643154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-09c1fc25-30fd-4fc7-ba3f-c319f16972e9 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:33.644404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-09c1fc25-30fd-4fc7-ba3f-c319f16972e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:33.726371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775c69b-f1df-4bfa-ae46-1d4a3530f261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:33.727485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775c69b-f1df-4bfa-ae46-1d4a3530f261 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:33.727772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775c69b-f1df-4bfa-ae46-1d4a3530f261 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:33.728050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775c69b-f1df-4bfa-ae46-1d4a3530f261 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:33.760220 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775c69b-f1df-4bfa-ae46-1d4a3530f261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-b775c69b-f1df-4bfa-ae46-1d4a3530f261 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:33.765933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:33.766909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:33.767692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 52/105] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:39:33.774247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775c69b-f1df-4bfa-ae46-1d4a3530f261 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:33.860356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 54/106] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:33.924108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c71e3-bda6-4a4a-b4e7-e5726b18911b None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:33.924396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c71e3-bda6-4a4a-b4e7-e5726b18911b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:33.924582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c71e3-bda6-4a4a-b4e7-e5726b18911b None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:33.926478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 55/107] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:33.931953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16057-ea8d-4271-86ea-8014a508f3b0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:33.932244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16057-ea8d-4271-86ea-8014a508f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:33.932524 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16057-ea8d-4271-86ea-8014a508f3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:33.950158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775c69b-f1df-4bfa-ae46-1d4a3530f261 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:33.970286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e0a16057-ea8d-4271-86ea-8014a508f3b0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:33.971542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e0a16057-ea8d-4271-86ea-8014a508f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:33.980614 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:34.004046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b107-037a-40de-99b3-894b2310fedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:34.004690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b107-037a-40de-99b3-894b2310fedc None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:34.004972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b107-037a-40de-99b3-894b2310fedc None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:34.005247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b107-037a-40de-99b3-894b2310fedc None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:34.006543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b107-037a-40de-99b3-894b2310fedc None admin] RBAC: Adding query filter params (name=reader) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:34.006863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b107-037a-40de-99b3-894b2310fedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:34.008607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b107-037a-40de-99b3-894b2310fedc None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:34.018296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 53/108] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:34.026021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b107-037a-40de-99b3-894b2310fedc None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:34.073403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 56/109] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:34.143612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282da40-e28d-4d6a-853e-d94c17d0c45a None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:34.144002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282da40-e28d-4d6a-853e-d94c17d0c45a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:34.144254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282da40-e28d-4d6a-853e-d94c17d0c45a None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:34.145162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b107-037a-40de-99b3-894b2310fedc None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:34.145528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 57/110] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:34.151611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d6ca-7060-4938-a35c-4a31c98810e0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:34.151885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d6ca-7060-4938-a35c-4a31c98810e0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:34.152173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1d6ca-7060-4938-a35c-4a31c98810e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:34.179620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:34.192283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b0c1d6ca-7060-4938-a35c-4a31c98810e0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:34.193753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b0c1d6ca-7060-4938-a35c-4a31c98810e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:34.197015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4d0c2-8765-447a-9a4a-00cad7df1850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:34.197725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4d0c2-8765-447a-9a4a-00cad7df1850 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:34.198004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4d0c2-8765-447a-9a4a-00cad7df1850 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:34.198277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4d0c2-8765-447a-9a4a-00cad7df1850 None admin] PATH_INFO: `/v3/users/0e7038eff5a746e1b07080d0c26355f3` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:34.216738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4d0c2-8765-447a-9a4a-00cad7df1850 None admin] RBAC: Authorizing `identity:get_user(user_id=0e7038eff5a746e1b07080d0c26355f3)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:34.218953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4d0c2-8765-447a-9a4a-00cad7df1850 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:34.221348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 54/111] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:34 2022] GET /identity/v3/users/0e7038eff5a746e1b07080d0c26355f3 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:34.225166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4d0c2-8765-447a-9a4a-00cad7df1850 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:34.286194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:34.379183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4d0c2-8765-447a-9a4a-00cad7df1850 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:34.386394 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 58/112] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:34.387342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1d6ca-7060-4938-a35c-4a31c98810e0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:34.467794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4b2c-628f-4094-977b-62f22c183f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:34.468567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4b2c-628f-4094-977b-62f22c183f4b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:34.469123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4b2c-628f-4094-977b-62f22c183f4b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:34.469404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4b2c-628f-4094-977b-62f22c183f4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:34.491407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4b2c-628f-4094-977b-62f22c183f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-f69b4b2c-628f-4094-977b-62f22c183f4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:34.499859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:34.500740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:34.501514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 55/113] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:34.502150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4b2c-628f-4094-977b-62f22c183f4b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:34.605561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1d6ca-7060-4938-a35c-4a31c98810e0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:34.667670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739f4e1-f459-4653-8e7b-7baf3da846e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:34.668350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f4e1-f459-4653-8e7b-7baf3da846e4 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:34.668829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f4e1-f459-4653-8e7b-7baf3da846e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:34.669291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739f4e1-f459-4653-8e7b-7baf3da846e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:34.672367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:34.691681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4b2c-628f-4094-977b-62f22c183f4b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:34.702531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:34.731554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4386b-40af-45a7-98fe-26de9ee148bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:34.732203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4386b-40af-45a7-98fe-26de9ee148bf None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:34.732461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4386b-40af-45a7-98fe-26de9ee148bf None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:34.732742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4386b-40af-45a7-98fe-26de9ee148bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:34.751589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4386b-40af-45a7-98fe-26de9ee148bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:34.757658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739f4e1-f459-4653-8e7b-7baf3da846e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:34.759192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739f4e1-f459-4653-8e7b-7baf3da846e4 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-abc4386b-40af-45a7-98fe-26de9ee148bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:34.759319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:34.760194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:34.760953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 56/114] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:39:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:34.762367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4386b-40af-45a7-98fe-26de9ee148bf None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:34.881063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 59/115] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:34.882568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d87a9-3689-4350-bd3b-9cd4068de406 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:34.882865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d87a9-3689-4350-bd3b-9cd4068de406 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:34.883122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d87a9-3689-4350-bd3b-9cd4068de406 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:34.884608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 60/116] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:34.885168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d87a9-3689-4350-bd3b-9cd4068de406 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:34.898741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4386b-40af-45a7-98fe-26de9ee148bf None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:34.929149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:34.936748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a771b7-adbf-46ac-b759-e5aa90c1461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:34.937015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a771b7-adbf-46ac-b759-e5aa90c1461d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:34.937235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a771b7-adbf-46ac-b759-e5aa90c1461d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:34.937556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a771b7-adbf-46ac-b759-e5aa90c1461d None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:34.938188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a771b7-adbf-46ac-b759-e5aa90c1461d None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:34.938498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a771b7-adbf-46ac-b759-e5aa90c1461d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:34.939954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a771b7-adbf-46ac-b759-e5aa90c1461d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:34.951498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 57/117] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:34.952211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a771b7-adbf-46ac-b759-e5aa90c1461d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:34.984862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:35.010733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d87a9-3689-4350-bd3b-9cd4068de406 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.050856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fa822-30d1-4443-b4d7-e23b08c42717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.051516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa822-30d1-4443-b4d7-e23b08c42717 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.051797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa822-30d1-4443-b4d7-e23b08c42717 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.052134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa822-30d1-4443-b4d7-e23b08c42717 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.063507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fa822-30d1-4443-b4d7-e23b08c42717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:35.067012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a771b7-adbf-46ac-b759-e5aa90c1461d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-f35fa822-30d1-4443-b4d7-e23b08c42717 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:35.068506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:35.069401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:35.070153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 61/118] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:35.071815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428422e-101e-4a18-bc0a-a49f1af3bcf7 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.072103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428422e-101e-4a18-bc0a-a49f1af3bcf7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.072368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428422e-101e-4a18-bc0a-a49f1af3bcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.091513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e428422e-101e-4a18-bc0a-a49f1af3bcf7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:35.092724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e428422e-101e-4a18-bc0a-a49f1af3bcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:35.122621 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe88018-9bfd-4eb0-9a63-7f29a9c3355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.123258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe88018-9bfd-4eb0-9a63-7f29a9c3355c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.123540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe88018-9bfd-4eb0-9a63-7f29a9c3355c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.123808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe88018-9bfd-4eb0-9a63-7f29a9c3355c None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.124592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe88018-9bfd-4eb0-9a63-7f29a9c3355c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:35.124921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe88018-9bfd-4eb0-9a63-7f29a9c3355c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:35.126393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe88018-9bfd-4eb0-9a63-7f29a9c3355c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:35.135574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 58/119] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:39:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:35.136431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe88018-9bfd-4eb0-9a63-7f29a9c3355c None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:35.172366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 62/120] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:35.173557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428422e-101e-4a18-bc0a-a49f1af3bcf7 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:35.209850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:35.251754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:35.269049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe88018-9bfd-4eb0-9a63-7f29a9c3355c None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.320517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17fdc-e7ed-48d0-9e22-85496aed2c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.321175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17fdc-e7ed-48d0-9e22-85496aed2c5a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.321456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17fdc-e7ed-48d0-9e22-85496aed2c5a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.321728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17fdc-e7ed-48d0-9e22-85496aed2c5a None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.322939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee17fdc-e7ed-48d0-9e22-85496aed2c5a None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:35.323263 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428422e-101e-4a18-bc0a-a49f1af3bcf7 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.324638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee17fdc-e7ed-48d0-9e22-85496aed2c5a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:35.332466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 59/121] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:35 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:35.332466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17fdc-e7ed-48d0-9e22-85496aed2c5a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:35.417612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e86646-44b5-4c02-a268-3684dc090513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.418566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e86646-44b5-4c02-a268-3684dc090513 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.419051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e86646-44b5-4c02-a268-3684dc090513 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.419534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e86646-44b5-4c02-a268-3684dc090513 None admin] PATH_INFO: `/v3/users/794a16f8475e4a71ad739f9516b9f0b7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.421522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e86646-44b5-4c02-a268-3684dc090513 None admin] RBAC: Authorizing `identity:get_user(user_id=794a16f8475e4a71ad739f9516b9f0b7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:35.423719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e86646-44b5-4c02-a268-3684dc090513 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:35.426641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 63/122] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:35 2022] GET /identity/v3/users/794a16f8475e4a71ad739f9516b9f0b7 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:35.428357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e86646-44b5-4c02-a268-3684dc090513 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:35.513442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17fdc-e7ed-48d0-9e22-85496aed2c5a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.540319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:35.551061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e86646-44b5-4c02-a268-3684dc090513 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.556342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02118e6-ee5b-4bba-a81a-71f06f82f4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.556964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02118e6-ee5b-4bba-a81a-71f06f82f4c4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.557268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02118e6-ee5b-4bba-a81a-71f06f82f4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.557505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02118e6-ee5b-4bba-a81a-71f06f82f4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.558184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02118e6-ee5b-4bba-a81a-71f06f82f4c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:35.558482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02118e6-ee5b-4bba-a81a-71f06f82f4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:35.559928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02118e6-ee5b-4bba-a81a-71f06f82f4c4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:35.574648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 60/123] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:35.574648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02118e6-ee5b-4bba-a81a-71f06f82f4c4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:35.596656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:35.599762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179a6db-1863-449e-8a65-ce0acc6309cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.600743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179a6db-1863-449e-8a65-ce0acc6309cd None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.601029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179a6db-1863-449e-8a65-ce0acc6309cd None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.601691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179a6db-1863-449e-8a65-ce0acc6309cd None admin] PATH_INFO: `/v3/users/794a16f8475e4a71ad739f9516b9f0b7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.602580 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179a6db-1863-449e-8a65-ce0acc6309cd None admin] RBAC: Authorizing `identity:get_user(user_id=794a16f8475e4a71ad739f9516b9f0b7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:35.604158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179a6db-1863-449e-8a65-ce0acc6309cd None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:35.605883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 64/124] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:35 2022] GET /identity/v3/users/794a16f8475e4a71ad739f9516b9f0b7 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:35.611217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179a6db-1863-449e-8a65-ce0acc6309cd None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:35.688622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02118e6-ee5b-4bba-a81a-71f06f82f4c4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.731785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179a6db-1863-449e-8a65-ce0acc6309cd None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.735707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de323e-abfc-4ffa-85e6-495af250e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.736331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de323e-abfc-4ffa-85e6-495af250e22f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.736621 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de323e-abfc-4ffa-85e6-495af250e22f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.736894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de323e-abfc-4ffa-85e6-495af250e22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.737644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de323e-abfc-4ffa-85e6-495af250e22f None admin] RBAC: Adding query filter params (role.id=385cdabadee14249a091591e0a2961f2, scope.project.id=5b45f2debc7148b79ed609906b98b179, user.id=0e7038eff5a746e1b07080d0c26355f3) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:35.737953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de323e-abfc-4ffa-85e6-495af250e22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:35.739472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de323e-abfc-4ffa-85e6-495af250e22f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:35.746758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 61/125] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:35 2022] GET /identity/v3/role_assignments?user.id=0e7038eff5a746e1b07080d0c26355f3&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=385cdabadee14249a091591e0a2961f2 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:35.752616 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de323e-abfc-4ffa-85e6-495af250e22f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:35.782379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f1f53-e115-41a1-8bcb-5f4c62aa66ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.782967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f1f53-e115-41a1-8bcb-5f4c62aa66ca None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.783283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f1f53-e115-41a1-8bcb-5f4c62aa66ca None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.783568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f1f53-e115-41a1-8bcb-5f4c62aa66ca None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.784881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f1f53-e115-41a1-8bcb-5f4c62aa66ca None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:35.786459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f1f53-e115-41a1-8bcb-5f4c62aa66ca None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:35.789213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 65/126] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:35 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:35.795142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f1f53-e115-41a1-8bcb-5f4c62aa66ca None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:35.829702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:35.888023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:35.914008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de323e-abfc-4ffa-85e6-495af250e22f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.938511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f1f53-e115-41a1-8bcb-5f4c62aa66ca None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:35.956104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e6e8-cffb-42c5-8db9-55946d6cfd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.956810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e6e8-cffb-42c5-8db9-55946d6cfd82 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.957092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e6e8-cffb-42c5-8db9-55946d6cfd82 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.957471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e6e8-cffb-42c5-8db9-55946d6cfd82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.972707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5e6e8-cffb-42c5-8db9-55946d6cfd82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:35.981936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c77889-da85-440f-982a-1a64f497afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:35.982588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c77889-da85-440f-982a-1a64f497afad None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-faa5e6e8-cffb-42c5-8db9-55946d6cfd82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:35.982836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:35.985035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:35.986933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:35.988451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c77889-da85-440f-982a-1a64f497afad None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:35.988451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c77889-da85-440f-982a-1a64f497afad None admin] PATH_INFO: `/v3/users/794a16f8475e4a71ad739f9516b9f0b7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:35.988451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c77889-da85-440f-982a-1a64f497afad None admin] RBAC: Authorizing `identity:get_user(user_id=794a16f8475e4a71ad739f9516b9f0b7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:35.988850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 62/127] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:35.988995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c77889-da85-440f-982a-1a64f497afad None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:35.989131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e6e8-cffb-42c5-8db9-55946d6cfd82 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:35.989267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 66/128] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:35 2022] GET /identity/v3/users/794a16f8475e4a71ad739f9516b9f0b7 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:35.989267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c77889-da85-440f-982a-1a64f497afad None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:36.128513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e6e8-cffb-42c5-8db9-55946d6cfd82 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:36.130936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:36.138512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c77889-da85-440f-982a-1a64f497afad None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:36.176669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61609e6e-6bd1-48be-8fe9-d231ba09d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:36.177577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c41d82-e0a9-43bd-92ed-385ab81cf6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:36.177914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609e6e-6bd1-48be-8fe9-d231ba09d1c9 None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:36.178225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c41d82-e0a9-43bd-92ed-385ab81cf6d1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:36.178575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c41d82-e0a9-43bd-92ed-385ab81cf6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:36.178715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609e6e-6bd1-48be-8fe9-d231ba09d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:36.178856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c41d82-e0a9-43bd-92ed-385ab81cf6d1 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:36.179298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61609e6e-6bd1-48be-8fe9-d231ba09d1c9 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179/users/794a16f8475e4a71ad739f9516b9f0b7/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:36.180119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c41d82-e0a9-43bd-92ed-385ab81cf6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:36.181700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61609e6e-6bd1-48be-8fe9-d231ba09d1c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b45f2debc7148b79ed609906b98b179, user_id=794a16f8475e4a71ad739f9516b9f0b7, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:36.181914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c41d82-e0a9-43bd-92ed-385ab81cf6d1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:36.183157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61609e6e-6bd1-48be-8fe9-d231ba09d1c9 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:36.183733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 63/129] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:35 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:36.184465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c41d82-e0a9-43bd-92ed-385ab81cf6d1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:36.201906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:36.267755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 67/130] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:39:35 2022] PUT /identity/v3/projects/5b45f2debc7148b79ed609906b98b179/users/794a16f8475e4a71ad739f9516b9f0b7/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:39:36.268920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61609e6e-6bd1-48be-8fe9-d231ba09d1c9 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:36.320671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c41d82-e0a9-43bd-92ed-385ab81cf6d1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:36.364172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4db55-fec6-473b-a537-00eec7ecc04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:36.364906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4db55-fec6-473b-a537-00eec7ecc04c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:36.365745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4db55-fec6-473b-a537-00eec7ecc04c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:36.366286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4db55-fec6-473b-a537-00eec7ecc04c None admin] PATH_INFO: `/v3/projects/2f29280910434b27914b2da39eba7c3b` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:36.367919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4db55-fec6-473b-a537-00eec7ecc04c None admin] RBAC: Authorizing `identity:get_project(project_id=2f29280910434b27914b2da39eba7c3b)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:36.369464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4db55-fec6-473b-a537-00eec7ecc04c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:36.371712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 64/131] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:36 2022] GET /identity/v3/projects/2f29280910434b27914b2da39eba7c3b => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:36.373122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98260c-eab1-4a41-8dda-2e8619ee02b7 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:36.373417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98260c-eab1-4a41-8dda-2e8619ee02b7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:36.373683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98260c-eab1-4a41-8dda-2e8619ee02b7 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:36.374946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 65/132] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:36.375736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98260c-eab1-4a41-8dda-2e8619ee02b7 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:36.426834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61609e6e-6bd1-48be-8fe9-d231ba09d1c9 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:36.481236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded016c-d926-490b-908d-7e321ba9ea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:36.482056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded016c-d926-490b-908d-7e321ba9ea68 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:36.482473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded016c-d926-490b-908d-7e321ba9ea68 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:36.482873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded016c-d926-490b-908d-7e321ba9ea68 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:36.483621 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:36.484143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded016c-d926-490b-908d-7e321ba9ea68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:36.484681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded016c-d926-490b-908d-7e321ba9ea68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:36.487637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded016c-d926-490b-908d-7e321ba9ea68 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:36.500118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 68/133] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:36.500962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded016c-d926-490b-908d-7e321ba9ea68 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:36.515126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98260c-eab1-4a41-8dda-2e8619ee02b7 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:36.537007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:36.563712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dcf12-db1b-46f0-9150-6a6385510671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:36.564399 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dcf12-db1b-46f0-9150-6a6385510671 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:36.564684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dcf12-db1b-46f0-9150-6a6385510671 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:36.564964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dcf12-db1b-46f0-9150-6a6385510671 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179/users/794a16f8475e4a71ad739f9516b9f0b7/roles/25294da9af854bf181e95bc99a9818c8` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:36.567201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dcf12-db1b-46f0-9150-6a6385510671 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b45f2debc7148b79ed609906b98b179, user_id=794a16f8475e4a71ad739f9516b9f0b7, role_id=25294da9af854bf181e95bc99a9818c8)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:36.570018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dcf12-db1b-46f0-9150-6a6385510671 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:36.635040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 66/134] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:39:36 2022] PUT /identity/v3/projects/5b45f2debc7148b79ed609906b98b179/users/794a16f8475e4a71ad739f9516b9f0b7/roles/25294da9af854bf181e95bc99a9818c8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:39:36.636208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe21bc-ef52-4664-8c14-6b08c7c1cc4c None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:36.636208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe21bc-ef52-4664-8c14-6b08c7c1cc4c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:36.636392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe21bc-ef52-4664-8c14-6b08c7c1cc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:36.657671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-42fe21bc-ef52-4664-8c14-6b08c7c1cc4c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:36.658748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-42fe21bc-ef52-4664-8c14-6b08c7c1cc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:36.676326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded016c-d926-490b-908d-7e321ba9ea68 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:36.755102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 67/135] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:36.757809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe21bc-ef52-4664-8c14-6b08c7c1cc4c None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:36.761594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b4a56-e1db-44d4-a3d4-66b9f53c2158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:36.763102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b4a56-e1db-44d4-a3d4-66b9f53c2158 None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:36.763102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b4a56-e1db-44d4-a3d4-66b9f53c2158 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:36.763102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b4a56-e1db-44d4-a3d4-66b9f53c2158 None admin] PATH_INFO: `/v3/projects/2f29280910434b27914b2da39eba7c3b/users/794a16f8475e4a71ad739f9516b9f0b7/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:36.768032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b4a56-e1db-44d4-a3d4-66b9f53c2158 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f29280910434b27914b2da39eba7c3b, user_id=794a16f8475e4a71ad739f9516b9f0b7, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:36.769614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b4a56-e1db-44d4-a3d4-66b9f53c2158 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:36.845121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:36.855660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 69/136] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:39:36 2022] PUT /identity/v3/projects/2f29280910434b27914b2da39eba7c3b/users/794a16f8475e4a71ad739f9516b9f0b7/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:39:36.906590 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe21bc-ef52-4664-8c14-6b08c7c1cc4c None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:36.956442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a79fe-f679-49be-8182-46f7492b9b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:36.957537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a79fe-f679-49be-8182-46f7492b9b0b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:36.958023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a79fe-f679-49be-8182-46f7492b9b0b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:36.958529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a79fe-f679-49be-8182-46f7492b9b0b None admin] PATH_INFO: `/v3/users/0cdd881142fc452aa383e6193f9f4daa` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:36.960180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a79fe-f679-49be-8182-46f7492b9b0b None admin] RBAC: Authorizing `identity:get_user(user_id=0cdd881142fc452aa383e6193f9f4daa)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:36.962079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a79fe-f679-49be-8182-46f7492b9b0b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:36.964999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 68/137] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:36 2022] GET /identity/v3/users/0cdd881142fc452aa383e6193f9f4daa => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:36.971393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b4a56-e1db-44d4-a3d4-66b9f53c2158 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:37.101034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:37.129785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b4a56-e1db-44d4-a3d4-66b9f53c2158 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:37.175813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51936be-3e3c-42b1-982d-41c7b468ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:37.176663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51936be-3e3c-42b1-982d-41c7b468ba71 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:37.178061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51936be-3e3c-42b1-982d-41c7b468ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:37.178595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51936be-3e3c-42b1-982d-41c7b468ba71 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:37.184100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51936be-3e3c-42b1-982d-41c7b468ba71 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:37.185621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51936be-3e3c-42b1-982d-41c7b468ba71 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:37.187591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 70/138] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:36 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:37.193577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a79fe-f679-49be-8182-46f7492b9b0b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:37.246946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51936be-3e3c-42b1-982d-41c7b468ba71 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:37.364329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a79fe-f679-49be-8182-46f7492b9b0b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:37.406106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f0e2e-c332-40f4-935e-085869e90763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:37.406106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f0e2e-c332-40f4-935e-085869e90763 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:37.406106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f0e2e-c332-40f4-935e-085869e90763 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:37.406106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f0e2e-c332-40f4-935e-085869e90763 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179/users/0cdd881142fc452aa383e6193f9f4daa/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:37.409873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f0e2e-c332-40f4-935e-085869e90763 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b45f2debc7148b79ed609906b98b179, user_id=0cdd881142fc452aa383e6193f9f4daa, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:37.412189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f0e2e-c332-40f4-935e-085869e90763 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:37.470280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51936be-3e3c-42b1-982d-41c7b468ba71 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:37.474929 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:37.480459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 69/139] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:39:37 2022] PUT /identity/v3/projects/5b45f2debc7148b79ed609906b98b179/users/0cdd881142fc452aa383e6193f9f4daa/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:39:37.519822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902baa39-dc67-41d6-b17a-3241166d135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:37.520467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902baa39-dc67-41d6-b17a-3241166d135f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:37.520755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902baa39-dc67-41d6-b17a-3241166d135f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:37.521713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902baa39-dc67-41d6-b17a-3241166d135f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:37.523009 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902baa39-dc67-41d6-b17a-3241166d135f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:37.524658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902baa39-dc67-41d6-b17a-3241166d135f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:37.526448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 71/140] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:37.532608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f0e2e-c332-40f4-935e-085869e90763 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:37.678291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f0e2e-c332-40f4-935e-085869e90763 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:37.728557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c3a7c-41cf-4bc8-a984-1737ab12de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:37.729192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c3a7c-41cf-4bc8-a984-1737ab12de40 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:37.729474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c3a7c-41cf-4bc8-a984-1737ab12de40 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:37.729748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c3a7c-41cf-4bc8-a984-1737ab12de40 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:37.730488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c3a7c-41cf-4bc8-a984-1737ab12de40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:37.732147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c3a7c-41cf-4bc8-a984-1737ab12de40 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:37.816911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 70/141] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:39:37 2022] POST /identity/v3/users => generated 283 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:38.057812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd2ac4-b977-4161-bdc7-1ab82db62281 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:38.058349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd2ac4-b977-4161-bdc7-1ab82db62281 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:38.058349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd2ac4-b977-4161-bdc7-1ab82db62281 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:38.059902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 72/142] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:38.065710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8b3e7-27cb-4193-a88b-d15f1aefc913 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:38.065997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8b3e7-27cb-4193-a88b-d15f1aefc913 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:38.066277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8b3e7-27cb-4193-a88b-d15f1aefc913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:38.092424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-3bc8b3e7-27cb-4193-a88b-d15f1aefc913 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:38.093559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3bc8b3e7-27cb-4193-a88b-d15f1aefc913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:38.156336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:38.176554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 71/143] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:38.657821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd2ac4-b977-4161-bdc7-1ab82db62281 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:38.680464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:38.787755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd2ac4-b977-4161-bdc7-1ab82db62281 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:38.833088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afe791-65c9-41a3-b445-6ebac4d965b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:38.834518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afe791-65c9-41a3-b445-6ebac4d965b1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:38.834806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afe791-65c9-41a3-b445-6ebac4d965b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:38.835077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afe791-65c9-41a3-b445-6ebac4d965b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:38.853348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afe791-65c9-41a3-b445-6ebac4d965b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-c9afe791-65c9-41a3-b445-6ebac4d965b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:38.858267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:38.860793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:38.862641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 73/144] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:38.866822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8b3e7-27cb-4193-a88b-d15f1aefc913 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:38.957585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09ef4c-6b09-4fe4-b2d4-3ce485610a35 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:38.958979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09ef4c-6b09-4fe4-b2d4-3ce485610a35 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:38.959442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09ef4c-6b09-4fe4-b2d4-3ce485610a35 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:38.961138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 74/145] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:38.967664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6fe91-4d91-4064-a30a-181b62fc617c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:38.967937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6fe91-4d91-4064-a30a-181b62fc617c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:38.968219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6fe91-4d91-4064-a30a-181b62fc617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:38.991336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-27d6fe91-4d91-4064-a30a-181b62fc617c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:38.993748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-27d6fe91-4d91-4064-a30a-181b62fc617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:39.016698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8b3e7-27cb-4193-a88b-d15f1aefc913 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:39.066815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4daa9-8fa2-4c35-a080-65705ff53b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:39.067474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4daa9-8fa2-4c35-a080-65705ff53b26 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:39.067935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4daa9-8fa2-4c35-a080-65705ff53b26 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:39.068174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4daa9-8fa2-4c35-a080-65705ff53b26 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:39.069221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4daa9-8fa2-4c35-a080-65705ff53b26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:39.069528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4daa9-8fa2-4c35-a080-65705ff53b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:39.070964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4daa9-8fa2-4c35-a080-65705ff53b26 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:39.082334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 72/146] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:39.092533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4daa9-8fa2-4c35-a080-65705ff53b26 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:39.168311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 75/147] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:39.195707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:39.272267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4daa9-8fa2-4c35-a080-65705ff53b26 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:39.319353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fdc8b-86d7-4ef9-bf9b-9bbedf42312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:39.320018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fdc8b-86d7-4ef9-bf9b-9bbedf42312f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:39.320298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fdc8b-86d7-4ef9-bf9b-9bbedf42312f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:39.320577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fdc8b-86d7-4ef9-bf9b-9bbedf42312f None admin] PATH_INFO: `/v3/users/0e7038eff5a746e1b07080d0c26355f3` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:39.321823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fdc8b-86d7-4ef9-bf9b-9bbedf42312f None admin] RBAC: Authorizing `identity:get_user(user_id=0e7038eff5a746e1b07080d0c26355f3)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:39.323331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fdc8b-86d7-4ef9-bf9b-9bbedf42312f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:39.324973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 73/148] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:39 2022] GET /identity/v3/users/0e7038eff5a746e1b07080d0c26355f3 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:39.330784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6fe91-4d91-4064-a30a-181b62fc617c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:39.336078 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:39.469214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6fe91-4d91-4064-a30a-181b62fc617c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:39.514142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94e23a-fd5c-44af-b057-42cbae393bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:39.514793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94e23a-fd5c-44af-b057-42cbae393bf2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:39.515080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94e23a-fd5c-44af-b057-42cbae393bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:39.515391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94e23a-fd5c-44af-b057-42cbae393bf2 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:39.516595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94e23a-fd5c-44af-b057-42cbae393bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:39.518084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94e23a-fd5c-44af-b057-42cbae393bf2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:39.520168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 76/149] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:39 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:39.528427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fdc8b-86d7-4ef9-bf9b-9bbedf42312f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:39.650334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fdc8b-86d7-4ef9-bf9b-9bbedf42312f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:39.670756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:39.694982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec093a-d56e-4b3b-85f5-2f100462c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:39.695706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec093a-d56e-4b3b-85f5-2f100462c8dd None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:39.696190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec093a-d56e-4b3b-85f5-2f100462c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:39.696470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec093a-d56e-4b3b-85f5-2f100462c8dd None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179/users/0e7038eff5a746e1b07080d0c26355f3/roles/385cdabadee14249a091591e0a2961f2` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:39.698557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec093a-d56e-4b3b-85f5-2f100462c8dd None admin] RBAC: Authorizing `identity:create_grant(project_id=5b45f2debc7148b79ed609906b98b179, user_id=0e7038eff5a746e1b07080d0c26355f3, role_id=385cdabadee14249a091591e0a2961f2)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:39.700066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec093a-d56e-4b3b-85f5-2f100462c8dd None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:39.785965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 74/150] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:39:39 2022] PUT /identity/v3/projects/5b45f2debc7148b79ed609906b98b179/users/0e7038eff5a746e1b07080d0c26355f3/roles/385cdabadee14249a091591e0a2961f2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:39:39.848348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94e23a-fd5c-44af-b057-42cbae393bf2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:39.940048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:39.983087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94e23a-fd5c-44af-b057-42cbae393bf2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:40.024265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30987ebd-a834-459c-913e-0c67c4df5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:40.024917 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30987ebd-a834-459c-913e-0c67c4df5f5a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:40.025196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30987ebd-a834-459c-913e-0c67c4df5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:40.025465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30987ebd-a834-459c-913e-0c67c4df5f5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:40.038744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30987ebd-a834-459c-913e-0c67c4df5f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-30987ebd-a834-459c-913e-0c67c4df5f5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:40.043831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:40.046282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:40.048185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 77/151] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:40.051920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec093a-d56e-4b3b-85f5-2f100462c8dd None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:40.169649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec093a-d56e-4b3b-85f5-2f100462c8dd None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:40.207522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a114629-30a1-447b-b3aa-f8ab46d4225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:40.208197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a114629-30a1-447b-b3aa-f8ab46d4225c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:40.208871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a114629-30a1-447b-b3aa-f8ab46d4225c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:40.209152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a114629-30a1-447b-b3aa-f8ab46d4225c None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:40.209905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a114629-30a1-447b-b3aa-f8ab46d4225c None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:40.210210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a114629-30a1-447b-b3aa-f8ab46d4225c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:40.211653 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a114629-30a1-447b-b3aa-f8ab46d4225c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:40.222280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 75/152] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:40.227691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30987ebd-a834-459c-913e-0c67c4df5f5a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:40.339797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30987ebd-a834-459c-913e-0c67c4df5f5a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:40.369631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510192b-a7b9-4dd2-8268-72939cb40144 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:40.369936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510192b-a7b9-4dd2-8268-72939cb40144 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:40.370176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510192b-a7b9-4dd2-8268-72939cb40144 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:40.371743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 76/153] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:40.377937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97f086-fca8-47dd-bc83-fd87bbc2744e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:40.378208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97f086-fca8-47dd-bc83-fd87bbc2744e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:40.378478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97f086-fca8-47dd-bc83-fd87bbc2744e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:40.396786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:40.404720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe41af4-bc1e-48eb-bfd4-75a14a232200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:40.405383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe41af4-bc1e-48eb-bfd4-75a14a232200 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:40.405660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe41af4-bc1e-48eb-bfd4-75a14a232200 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:40.405933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe41af4-bc1e-48eb-bfd4-75a14a232200 None admin] PATH_INFO: `/v3/users/794a16f8475e4a71ad739f9516b9f0b7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:40.407369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7c97f086-fca8-47dd-bc83-fd87bbc2744e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:40.408587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7c97f086-fca8-47dd-bc83-fd87bbc2744e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:40.414708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe41af4-bc1e-48eb-bfd4-75a14a232200 None admin] RBAC: Authorizing `identity:get_user(user_id=794a16f8475e4a71ad739f9516b9f0b7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:40.414708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe41af4-bc1e-48eb-bfd4-75a14a232200 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:40.415785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 78/154] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:40 2022] GET /identity/v3/users/794a16f8475e4a71ad739f9516b9f0b7 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:40.453456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe41af4-bc1e-48eb-bfd4-75a14a232200 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:40.464187 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:40.538399 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 77/155] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:40.578788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe41af4-bc1e-48eb-bfd4-75a14a232200 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:40.618338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d98b8-1c0a-4d93-a627-c628ec491da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:40.618872 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d98b8-1c0a-4d93-a627-c628ec491da2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:40.619152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d98b8-1c0a-4d93-a627-c628ec491da2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:40.619455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d98b8-1c0a-4d93-a627-c628ec491da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:40.694699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:40.703591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d98b8-1c0a-4d93-a627-c628ec491da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:40.705277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d98b8-1c0a-4d93-a627-c628ec491da2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:40.830952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 79/156] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 19:39:40.837412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97f086-fca8-47dd-bc83-fd87bbc2744e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:40.926011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1e0db-21d7-4071-929e-c4da0c19d6c4 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:40.926347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1e0db-21d7-4071-929e-c4da0c19d6c4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:40.926562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1e0db-21d7-4071-929e-c4da0c19d6c4 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:40.928337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 80/157] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:40.934340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9621a-5b1e-4b01-abb6-1644a641d571 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:40.934647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9621a-5b1e-4b01-abb6-1644a641d571 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:40.934892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9621a-5b1e-4b01-abb6-1644a641d571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:40.969853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-fcf9621a-5b1e-4b01-abb6-1644a641d571 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:40.971170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fcf9621a-5b1e-4b01-abb6-1644a641d571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:41.003371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97f086-fca8-47dd-bc83-fd87bbc2744e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:41.062171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fe6ec-995c-4189-a9f9-cea2b0013d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:41.062817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fe6ec-995c-4189-a9f9-cea2b0013d33 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:41.063092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fe6ec-995c-4189-a9f9-cea2b0013d33 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:41.063390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fe6ec-995c-4189-a9f9-cea2b0013d33 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:41.069096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fe6ec-995c-4189-a9f9-cea2b0013d33 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:41.070631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fe6ec-995c-4189-a9f9-cea2b0013d33 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:41.072667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 78/158] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:40 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:41.073708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74895d68-b840-413d-b1e6-57547a26cc7c None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:41.073989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74895d68-b840-413d-b1e6-57547a26cc7c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:41.074261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74895d68-b840-413d-b1e6-57547a26cc7c None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:41.075779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 79/159] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:41.080848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74895d68-b840-413d-b1e6-57547a26cc7c None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:41.141222 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 81/160] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:41.142668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987959d7-bd23-4847-acdd-649519b1a6ea None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:41.142924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987959d7-bd23-4847-acdd-649519b1a6ea None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:41.143193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987959d7-bd23-4847-acdd-649519b1a6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:41.159612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:41.169470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-987959d7-bd23-4847-acdd-649519b1a6ea None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:41.170806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-987959d7-bd23-4847-acdd-649519b1a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:41.198131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:41.248310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 82/161] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:41.249926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987959d7-bd23-4847-acdd-649519b1a6ea None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:41.304075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74895d68-b840-413d-b1e6-57547a26cc7c None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:41.392468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987959d7-bd23-4847-acdd-649519b1a6ea None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:41.392902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81da11b-1a90-4441-ac48-6370ba5a2f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:41.393535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81da11b-1a90-4441-ac48-6370ba5a2f66 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:41.393814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81da11b-1a90-4441-ac48-6370ba5a2f66 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:41.394086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81da11b-1a90-4441-ac48-6370ba5a2f66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:41.394844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81da11b-1a90-4441-ac48-6370ba5a2f66 None admin] RBAC: Adding query filter params (role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=5b45f2debc7148b79ed609906b98b179, user.id=794a16f8475e4a71ad739f9516b9f0b7) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:41.395152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81da11b-1a90-4441-ac48-6370ba5a2f66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:41.397838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81da11b-1a90-4441-ac48-6370ba5a2f66 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:41.421271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 80/162] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:41 2022] GET /identity/v3/role_assignments?user.id=794a16f8475e4a71ad739f9516b9f0b7&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 608 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:41.436698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087b29e-8c50-4af4-bbef-5069917c07d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:41.438155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087b29e-8c50-4af4-bbef-5069917c07d3 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:41.438859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087b29e-8c50-4af4-bbef-5069917c07d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:41.439572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087b29e-8c50-4af4-bbef-5069917c07d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:41.457130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087b29e-8c50-4af4-bbef-5069917c07d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-8087b29e-8c50-4af4-bbef-5069917c07d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:41.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:41.464118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:41.464876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:41.467612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 83/163] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:39:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:41.475756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81da11b-1a90-4441-ac48-6370ba5a2f66 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:41.581326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087b29e-8c50-4af4-bbef-5069917c07d3 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:41.652828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:41.699264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81da11b-1a90-4441-ac48-6370ba5a2f66 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:41.699264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:41.807333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37793763-c4e7-4fb9-acd6-6f62045b583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:41.807333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37793763-c4e7-4fb9-acd6-6f62045b583a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:41.807333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37793763-c4e7-4fb9-acd6-6f62045b583a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:41.807333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37793763-c4e7-4fb9-acd6-6f62045b583a None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:41.807689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37793763-c4e7-4fb9-acd6-6f62045b583a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:41.807689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37793763-c4e7-4fb9-acd6-6f62045b583a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:41.807689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37793763-c4e7-4fb9-acd6-6f62045b583a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:41.808415 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087b29e-8c50-4af4-bbef-5069917c07d3 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:41.822760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 81/164] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:39:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:41.828250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37793763-c4e7-4fb9-acd6-6f62045b583a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:41.875442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbe277-f9e7-4324-b99d-84483fed1f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:41.876293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbe277-f9e7-4324-b99d-84483fed1f61 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:41.876575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbe277-f9e7-4324-b99d-84483fed1f61 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:41.876846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbe277-f9e7-4324-b99d-84483fed1f61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:41.898432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbbe277-f9e7-4324-b99d-84483fed1f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-6fbbe277-f9e7-4324-b99d-84483fed1f61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:41.903706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:41.904626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:41.905405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 84/165] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:41.912260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbe277-f9e7-4324-b99d-84483fed1f61 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:42.047213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:42.107457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37793763-c4e7-4fb9-acd6-6f62045b583a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:42.107954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbe277-f9e7-4324-b99d-84483fed1f61 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:42.132190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4afd5-1d3a-4b7c-a64e-6fa3dbb450ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:42.132856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4afd5-1d3a-4b7c-a64e-6fa3dbb450ce None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:42.133140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4afd5-1d3a-4b7c-a64e-6fa3dbb450ce None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:42.133417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4afd5-1d3a-4b7c-a64e-6fa3dbb450ce None admin] PATH_INFO: `/v3/users/794a16f8475e4a71ad739f9516b9f0b7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:42.135410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4afd5-1d3a-4b7c-a64e-6fa3dbb450ce None admin] RBAC: Authorizing `identity:get_user(user_id=794a16f8475e4a71ad739f9516b9f0b7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:42.136899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4afd5-1d3a-4b7c-a64e-6fa3dbb450ce None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:42.138906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 82/166] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:41 2022] GET /identity/v3/users/794a16f8475e4a71ad739f9516b9f0b7 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:42.139527 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4afd5-1d3a-4b7c-a64e-6fa3dbb450ce None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:42.155371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1856b5-450a-4975-bbd8-fc27b7557cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:42.156026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1856b5-450a-4975-bbd8-fc27b7557cbf None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:42.156303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1856b5-450a-4975-bbd8-fc27b7557cbf None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:42.156574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1856b5-450a-4975-bbd8-fc27b7557cbf None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:42.157280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1856b5-450a-4975-bbd8-fc27b7557cbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:42.157589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1856b5-450a-4975-bbd8-fc27b7557cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:42.159189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1856b5-450a-4975-bbd8-fc27b7557cbf None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:42.174168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 85/167] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:42.176467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1856b5-450a-4975-bbd8-fc27b7557cbf None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:42.212762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:42.365452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1856b5-450a-4975-bbd8-fc27b7557cbf None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:42.389466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4afd5-1d3a-4b7c-a64e-6fa3dbb450ce None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:42.443802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86b37c-4e02-4a83-b0ef-928aa3b85b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:42.444480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b37c-4e02-4a83-b0ef-928aa3b85b91 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:42.444949 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b37c-4e02-4a83-b0ef-928aa3b85b91 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:42.445350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b37c-4e02-4a83-b0ef-928aa3b85b91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:42.471479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:42.488647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e7cd4-268e-4b5c-88d4-206e252bb039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:42.489308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e7cd4-268e-4b5c-88d4-206e252bb039 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:42.490240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e7cd4-268e-4b5c-88d4-206e252bb039 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:42.490703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e7cd4-268e-4b5c-88d4-206e252bb039 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:42.524335 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e7cd4-268e-4b5c-88d4-206e252bb039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-454e7cd4-268e-4b5c-88d4-206e252bb039 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:42.529318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:42.530196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:42.530992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 83/168] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:42.531682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e7cd4-268e-4b5c-88d4-206e252bb039 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:42.603177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86b37c-4e02-4a83-b0ef-928aa3b85b91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:42.605694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86b37c-4e02-4a83-b0ef-928aa3b85b91 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:42.705543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:42.720087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e7cd4-268e-4b5c-88d4-206e252bb039 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:42.761204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4677b-c48f-4d06-bd3b-c25e23b92997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:42.762415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4677b-c48f-4d06-bd3b-c25e23b92997 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:42.762916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4677b-c48f-4d06-bd3b-c25e23b92997 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:42.763413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4677b-c48f-4d06-bd3b-c25e23b92997 None admin] PATH_INFO: `/v3/users/0cdd881142fc452aa383e6193f9f4daa` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:42.764822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4677b-c48f-4d06-bd3b-c25e23b92997 None admin] RBAC: Authorizing `identity:get_user(user_id=0cdd881142fc452aa383e6193f9f4daa)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:42.766507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4677b-c48f-4d06-bd3b-c25e23b92997 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:42.768900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 84/169] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:42 2022] GET /identity/v3/users/0cdd881142fc452aa383e6193f9f4daa => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:42.770227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4677b-c48f-4d06-bd3b-c25e23b92997 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:42.854350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 86/170] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:42.858118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da098cbb-c70f-4ef0-aed6-43f362006f6c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:42.858399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da098cbb-c70f-4ef0-aed6-43f362006f6c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:42.858672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da098cbb-c70f-4ef0-aed6-43f362006f6c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:42.862292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 87/171] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:42.863394 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da098cbb-c70f-4ef0-aed6-43f362006f6c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:42.958312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:42.984897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4677b-c48f-4d06-bd3b-c25e23b92997 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:43.056462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311da5be-058c-4509-88a6-e74113ec09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:43.057253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da5be-058c-4509-88a6-e74113ec09de None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.057882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da5be-058c-4509-88a6-e74113ec09de None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.058162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da5be-058c-4509-88a6-e74113ec09de None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.059141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311da5be-058c-4509-88a6-e74113ec09de None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:43.059478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311da5be-058c-4509-88a6-e74113ec09de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:43.061698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311da5be-058c-4509-88a6-e74113ec09de None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:43.064440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da098cbb-c70f-4ef0-aed6-43f362006f6c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:43.081474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 85/172] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:43.082170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311da5be-058c-4509-88a6-e74113ec09de None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:43.135605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:43.136968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a236c2-8976-4085-b184-61405445523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:43.137599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a236c2-8976-4085-b184-61405445523c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.137883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a236c2-8976-4085-b184-61405445523c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.138288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a236c2-8976-4085-b184-61405445523c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.243744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a236c2-8976-4085-b184-61405445523c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:43.245161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a236c2-8976-4085-b184-61405445523c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:43.248648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311da5be-058c-4509-88a6-e74113ec09de None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:43.291515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:43.292267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ab592-819c-447d-91e6-78ebd27f071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:43.292926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ab592-819c-447d-91e6-78ebd27f071c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.293204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ab592-819c-447d-91e6-78ebd27f071c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.298779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ab592-819c-447d-91e6-78ebd27f071c None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.298779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ab592-819c-447d-91e6-78ebd27f071c None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:43.298779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ab592-819c-447d-91e6-78ebd27f071c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:43.298779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 86/173] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:43 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:43.299383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9df660-3a19-4830-b56b-bddf4ad72d55 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.299665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9df660-3a19-4830-b56b-bddf4ad72d55 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.299933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9df660-3a19-4830-b56b-bddf4ad72d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.325410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0b9df660-3a19-4830-b56b-bddf4ad72d55 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:43.326678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0b9df660-3a19-4830-b56b-bddf4ad72d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:43.359284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 88/174] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:43.360141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a236c2-8976-4085-b184-61405445523c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:43.413257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 87/175] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:43.414568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202e6d2-9259-49a1-9693-84a5c7d3927d None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.414853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202e6d2-9259-49a1-9693-84a5c7d3927d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.415138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202e6d2-9259-49a1-9693-84a5c7d3927d None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.416649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 88/176] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:43.420438 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b97e-78a9-4e7c-8ab3-592ee8e4f85d None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.420936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b97e-78a9-4e7c-8ab3-592ee8e4f85d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.421205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b97e-78a9-4e7c-8ab3-592ee8e4f85d None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.422846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 89/177] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:43.427297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b97e-78a9-4e7c-8ab3-592ee8e4f85d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:43.443628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:43.488315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a236c2-8976-4085-b184-61405445523c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:43.529782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cba8e-c01d-4819-8263-7dc1455ee217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:43.530379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cba8e-c01d-4819-8263-7dc1455ee217 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.530618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cba8e-c01d-4819-8263-7dc1455ee217 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.530891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cba8e-c01d-4819-8263-7dc1455ee217 None admin] PATH_INFO: `/v3/users/794a16f8475e4a71ad739f9516b9f0b7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.532078 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cba8e-c01d-4819-8263-7dc1455ee217 None admin] RBAC: Authorizing `identity:get_user(user_id=794a16f8475e4a71ad739f9516b9f0b7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:43.533687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cba8e-c01d-4819-8263-7dc1455ee217 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:43.539535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 89/178] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:43 2022] GET /identity/v3/users/794a16f8475e4a71ad739f9516b9f0b7 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:43.539535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1462358-369c-41fc-a910-78ae56045bdb None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.539535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1462358-369c-41fc-a910-78ae56045bdb None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.539535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1462358-369c-41fc-a910-78ae56045bdb None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.539535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 90/179] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:43.539926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1462358-369c-41fc-a910-78ae56045bdb None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:43.542241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b97e-78a9-4e7c-8ab3-592ee8e4f85d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:43.555907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:43.585640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baf9dc-e4c6-4401-ab9a-b444453da52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:43.586283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf9dc-e4c6-4401-ab9a-b444453da52c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.586563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf9dc-e4c6-4401-ab9a-b444453da52c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.586835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baf9dc-e4c6-4401-ab9a-b444453da52c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.587686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf9dc-e4c6-4401-ab9a-b444453da52c None admin] RBAC: Adding query filter params (role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=5b45f2debc7148b79ed609906b98b179, user.id=794a16f8475e4a71ad739f9516b9f0b7) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:43.587994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf9dc-e4c6-4401-ab9a-b444453da52c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:43.589456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baf9dc-e4c6-4401-ab9a-b444453da52c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:43.596483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 90/180] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:43 2022] GET /identity/v3/role_assignments?user.id=794a16f8475e4a71ad739f9516b9f0b7&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=25294da9af854bf181e95bc99a9818c8 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:43.608729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c8775-6e6d-4a57-a300-cad58dc05318 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.609061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c8775-6e6d-4a57-a300-cad58dc05318 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.609290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c8775-6e6d-4a57-a300-cad58dc05318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.638884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0b2c8775-6e6d-4a57-a300-cad58dc05318 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:43.640158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0b2c8775-6e6d-4a57-a300-cad58dc05318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:43.702854 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1462358-369c-41fc-a910-78ae56045bdb None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:43.730699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 91/181] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:43.732440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960f0ed-7ff6-4321-94e4-2839a53d9b2e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.732971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960f0ed-7ff6-4321-94e4-2839a53d9b2e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.733438 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960f0ed-7ff6-4321-94e4-2839a53d9b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.756728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-1960f0ed-7ff6-4321-94e4-2839a53d9b2e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:43.757481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c4f1-3569-4eb0-8dab-fef12bc0a9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:43.758206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c4f1-3569-4eb0-8dab-fef12bc0a9b2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.758487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c4f1-3569-4eb0-8dab-fef12bc0a9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.758759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8c4f1-3569-4eb0-8dab-fef12bc0a9b2 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.759986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8c4f1-3569-4eb0-8dab-fef12bc0a9b2 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:43.760239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1960f0ed-7ff6-4321-94e4-2839a53d9b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:43.761481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8c4f1-3569-4eb0-8dab-fef12bc0a9b2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:43.764798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:43.764948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 91/182] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:43 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:43.765741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c4f1-3569-4eb0-8dab-fef12bc0a9b2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:43.854756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 92/183] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:43.856056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f64b1-a8c2-43ab-be7f-6f61278a103c None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.856437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f64b1-a8c2-43ab-be7f-6f61278a103c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.856804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f64b1-a8c2-43ab-be7f-6f61278a103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.877950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-f00f64b1-a8c2-43ab-be7f-6f61278a103c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:43.879328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f00f64b1-a8c2-43ab-be7f-6f61278a103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:43.884804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:43.912570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8c4f1-3569-4eb0-8dab-fef12bc0a9b2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:43.954452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90553c78-2c03-4b67-888a-e3262460a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:43.955079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553c78-2c03-4b67-888a-e3262460a5bf None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:43.955391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553c78-2c03-4b67-888a-e3262460a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:43.955663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553c78-2c03-4b67-888a-e3262460a5bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:43.972451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 93/184] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:43.973333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f64b1-a8c2-43ab-be7f-6f61278a103c None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.051481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:44.093286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f64b1-a8c2-43ab-be7f-6f61278a103c None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:44.098067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90553c78-2c03-4b67-888a-e3262460a5bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:44.100642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90553c78-2c03-4b67-888a-e3262460a5bf None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:44.142820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28ad15-4314-4f6e-9917-f92d90009e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:44.144898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28ad15-4314-4f6e-9917-f92d90009e38 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:44.144898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28ad15-4314-4f6e-9917-f92d90009e38 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:44.144898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28ad15-4314-4f6e-9917-f92d90009e38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:44.160963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28ad15-4314-4f6e-9917-f92d90009e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-3e28ad15-4314-4f6e-9917-f92d90009e38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:44.168363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:44.169288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:44.170069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:44.173052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 94/185] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:39:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:44.174163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28ad15-4314-4f6e-9917-f92d90009e38 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.207772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:44.232741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 92/186] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:44.233479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90553c78-2c03-4b67-888a-e3262460a5bf None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.296493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28ad15-4314-4f6e-9917-f92d90009e38 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:44.331851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:44.338658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d38d6b-d186-4c81-9e3b-050ccf1c91b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:44.339296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38d6b-d186-4c81-9e3b-050ccf1c91b0 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:44.339664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38d6b-d186-4c81-9e3b-050ccf1c91b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:44.339939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d38d6b-d186-4c81-9e3b-050ccf1c91b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:44.340715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d38d6b-d186-4c81-9e3b-050ccf1c91b0 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=5b45f2debc7148b79ed609906b98b179, user.id=0cdd881142fc452aa383e6193f9f4daa) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:44.341028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d38d6b-d186-4c81-9e3b-050ccf1c91b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:44.342491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d38d6b-d186-4c81-9e3b-050ccf1c91b0 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:44.343999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90553c78-2c03-4b67-888a-e3262460a5bf None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:44.348564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 95/187] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:44 2022] GET /identity/v3/role_assignments?user.id=0cdd881142fc452aa383e6193f9f4daa&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=9ec7f759c0a64655b794dfb597930076 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:44.349968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d38d6b-d186-4c81-9e3b-050ccf1c91b0 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.395278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f98b-d13a-4afd-9747-d35d5d9b4c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:44.396468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f98b-d13a-4afd-9747-d35d5d9b4c96 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:44.396745 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f98b-d13a-4afd-9747-d35d5d9b4c96 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:44.397012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f98b-d13a-4afd-9747-d35d5d9b4c96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:44.398286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28f98b-d13a-4afd-9747-d35d5d9b4c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:44.399865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28f98b-d13a-4afd-9747-d35d5d9b4c96 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:44.403967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 93/188] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:44.403967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f98b-d13a-4afd-9747-d35d5d9b4c96 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.465498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:44.480078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d38d6b-d186-4c81-9e3b-050ccf1c91b0 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:44.529464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e151-b0e7-46bc-8c1a-e68ea2781128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:44.530107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e151-b0e7-46bc-8c1a-e68ea2781128 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:44.530384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e151-b0e7-46bc-8c1a-e68ea2781128 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:44.530653 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e151-b0e7-46bc-8c1a-e68ea2781128 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:44.531131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f98b-d13a-4afd-9747-d35d5d9b4c96 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:44.547082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31e151-b0e7-46bc-8c1a-e68ea2781128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-5e31e151-b0e7-46bc-8c1a-e68ea2781128 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:44.554087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:44.555059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:44.556001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 96/189] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:39:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:44.557297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e151-b0e7-46bc-8c1a-e68ea2781128 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.582987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95781256-c88d-4c96-a428-54d844135aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:44.586310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95781256-c88d-4c96-a428-54d844135aac None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:44.586310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95781256-c88d-4c96-a428-54d844135aac None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:44.586310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95781256-c88d-4c96-a428-54d844135aac None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:44.586672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95781256-c88d-4c96-a428-54d844135aac None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:44.587046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95781256-c88d-4c96-a428-54d844135aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:44.588508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95781256-c88d-4c96-a428-54d844135aac None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:44.597376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 94/190] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:44.598224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95781256-c88d-4c96-a428-54d844135aac None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.624316 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:44.677592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e151-b0e7-46bc-8c1a-e68ea2781128 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:44.713673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cb04d-ac1b-4dc4-ba47-aa2542977ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:44.714306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cb04d-ac1b-4dc4-ba47-aa2542977ba2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:44.714610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cb04d-ac1b-4dc4-ba47-aa2542977ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:44.714881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738cb04d-ac1b-4dc4-ba47-aa2542977ba2 None admin] PATH_INFO: `/v3/projects/2f29280910434b27914b2da39eba7c3b` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:44.716109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cb04d-ac1b-4dc4-ba47-aa2542977ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=2f29280910434b27914b2da39eba7c3b)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:44.717715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738cb04d-ac1b-4dc4-ba47-aa2542977ba2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:44.718924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95781256-c88d-4c96-a428-54d844135aac None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:44.719382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 97/191] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:44 2022] GET /identity/v3/projects/2f29280910434b27914b2da39eba7c3b => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:44.720135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cb04d-ac1b-4dc4-ba47-aa2542977ba2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.733015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:44.761405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f4160-2852-4a27-b5a8-0d4c1f98d7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:44.762042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f4160-2852-4a27-b5a8-0d4c1f98d7c6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:44.762318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f4160-2852-4a27-b5a8-0d4c1f98d7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:44.762590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f4160-2852-4a27-b5a8-0d4c1f98d7c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:44.774036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f4160-2852-4a27-b5a8-0d4c1f98d7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-da5f4160-2852-4a27-b5a8-0d4c1f98d7c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:44.778913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:44.779849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 95/192] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:44.783940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f4160-2852-4a27-b5a8-0d4c1f98d7c6 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.844460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738cb04d-ac1b-4dc4-ba47-aa2542977ba2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:44.868802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:44.880338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535476-746d-4b68-8f11-3c8dd2885562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:44.883497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535476-746d-4b68-8f11-3c8dd2885562 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:44.883497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535476-746d-4b68-8f11-3c8dd2885562 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:44.883497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535476-746d-4b68-8f11-3c8dd2885562 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:44.883497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6535476-746d-4b68-8f11-3c8dd2885562 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:44.883908 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6535476-746d-4b68-8f11-3c8dd2885562 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:44.895148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f4160-2852-4a27-b5a8-0d4c1f98d7c6 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:44.937733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b5c37-afd3-4aa4-a1d6-34bbec26d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:44.938346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b5c37-afd3-4aa4-a1d6-34bbec26d84a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:44.938621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b5c37-afd3-4aa4-a1d6-34bbec26d84a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:44.938885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b5c37-afd3-4aa4-a1d6-34bbec26d84a None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:44.939605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b5c37-afd3-4aa4-a1d6-34bbec26d84a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:44.939902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b5c37-afd3-4aa4-a1d6-34bbec26d84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:44.941334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b5c37-afd3-4aa4-a1d6-34bbec26d84a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:44.950977 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 96/193] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:39:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:44.951839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b5c37-afd3-4aa4-a1d6-34bbec26d84a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:44.995256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 98/194] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:39:44 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:44.995256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535476-746d-4b68-8f11-3c8dd2885562 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:45.003273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:45.075573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b5c37-afd3-4aa4-a1d6-34bbec26d84a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:45.112435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535476-746d-4b68-8f11-3c8dd2885562 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:45.119769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e05796-3037-4b5c-8ef2-26e1bad702f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:45.120434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e05796-3037-4b5c-8ef2-26e1bad702f0 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:45.120712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e05796-3037-4b5c-8ef2-26e1bad702f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:45.120985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e05796-3037-4b5c-8ef2-26e1bad702f0 None admin] PATH_INFO: `/v3/users/21d33a975e494f76a2bcbb4425cfbbc3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:45.143426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e05796-3037-4b5c-8ef2-26e1bad702f0 None admin] RBAC: Authorizing `identity:get_user(user_id=21d33a975e494f76a2bcbb4425cfbbc3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:45.145006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e05796-3037-4b5c-8ef2-26e1bad702f0 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:45.147119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 97/195] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:44 2022] GET /identity/v3/users/21d33a975e494f76a2bcbb4425cfbbc3 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:45.147876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e05796-3037-4b5c-8ef2-26e1bad702f0 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:45.165353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef6475-bca9-4f1e-9266-3123d34ae2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:45.166164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6475-bca9-4f1e-9266-3123d34ae2d7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:45.166862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6475-bca9-4f1e-9266-3123d34ae2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:45.167152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef6475-bca9-4f1e-9266-3123d34ae2d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:45.168260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef6475-bca9-4f1e-9266-3123d34ae2d7 None admin] RBAC: Adding query filter params (role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=2f29280910434b27914b2da39eba7c3b, user.id=794a16f8475e4a71ad739f9516b9f0b7) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:45.168576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef6475-bca9-4f1e-9266-3123d34ae2d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:45.170547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef6475-bca9-4f1e-9266-3123d34ae2d7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:45.179883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 99/196] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:44 2022] GET /identity/v3/role_assignments?user.id=794a16f8475e4a71ad739f9516b9f0b7&scope.project.id=2f29280910434b27914b2da39eba7c3b&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:45.180738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef6475-bca9-4f1e-9266-3123d34ae2d7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:45.249202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:45.282893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:45.295027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e05796-3037-4b5c-8ef2-26e1bad702f0 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:45.342994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef6475-bca9-4f1e-9266-3123d34ae2d7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:45.343842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd6bbe-e467-4a22-9c42-0b068a3a8ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:45.344784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6bbe-e467-4a22-9c42-0b068a3a8ef7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:45.345269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6bbe-e467-4a22-9c42-0b068a3a8ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:45.345733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6bbe-e467-4a22-9c42-0b068a3a8ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:45.346649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd6bbe-e467-4a22-9c42-0b068a3a8ef7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:45.347371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd6bbe-e467-4a22-9c42-0b068a3a8ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:45.350716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd6bbe-e467-4a22-9c42-0b068a3a8ef7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:45.364167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 98/197] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:45.366272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd6bbe-e467-4a22-9c42-0b068a3a8ef7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:45.400035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d3be9-1cbc-40c9-a08e-b06408286559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:45.401209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d3be9-1cbc-40c9-a08e-b06408286559 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:45.401209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d3be9-1cbc-40c9-a08e-b06408286559 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:45.401209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d3be9-1cbc-40c9-a08e-b06408286559 None admin] PATH_INFO: `/v3/users/21d33a975e494f76a2bcbb4425cfbbc3` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:45.403073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d3be9-1cbc-40c9-a08e-b06408286559 None admin] RBAC: Authorizing `identity:get_user(user_id=21d33a975e494f76a2bcbb4425cfbbc3)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:45.405452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d3be9-1cbc-40c9-a08e-b06408286559 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:45.406980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 100/198] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:45 2022] GET /identity/v3/users/21d33a975e494f76a2bcbb4425cfbbc3 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:45.407849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d3be9-1cbc-40c9-a08e-b06408286559 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:45.539436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd6bbe-e467-4a22-9c42-0b068a3a8ef7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:45.555381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d3be9-1cbc-40c9-a08e-b06408286559 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:45.567270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:45.585861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd495f-a51d-40bb-813a-7d5563c56a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:45.586481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd495f-a51d-40bb-813a-7d5563c56a03 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:45.586758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd495f-a51d-40bb-813a-7d5563c56a03 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:45.587109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd495f-a51d-40bb-813a-7d5563c56a03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:45.593719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fcce3-6b6f-41e8-a2a5-3068c599d0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:45.594661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fcce3-6b6f-41e8-a2a5-3068c599d0b5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:45.595000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fcce3-6b6f-41e8-a2a5-3068c599d0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:45.595362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fcce3-6b6f-41e8-a2a5-3068c599d0b5 None admin] PATH_INFO: `/v3/users/0e7038eff5a746e1b07080d0c26355f3` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:45.596596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fcce3-6b6f-41e8-a2a5-3068c599d0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=0e7038eff5a746e1b07080d0c26355f3)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:45.598780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fcce3-6b6f-41e8-a2a5-3068c599d0b5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:45.605743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 101/199] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:45 2022] GET /identity/v3/users/0e7038eff5a746e1b07080d0c26355f3 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:45.606686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fcce3-6b6f-41e8-a2a5-3068c599d0b5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:45.627636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:45.691778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd495f-a51d-40bb-813a-7d5563c56a03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:45.694332 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd495f-a51d-40bb-813a-7d5563c56a03 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:45.727495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fcce3-6b6f-41e8-a2a5-3068c599d0b5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:45.771512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3517cc9-b1a4-46c6-8e22-1ed09826fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:45.772348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3517cc9-b1a4-46c6-8e22-1ed09826fc0e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:45.772738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3517cc9-b1a4-46c6-8e22-1ed09826fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:45.773023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3517cc9-b1a4-46c6-8e22-1ed09826fc0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:45.835342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:45.837739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 99/200] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:45.839336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd495f-a51d-40bb-813a-7d5563c56a03 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:45.859467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3517cc9-b1a4-46c6-8e22-1ed09826fc0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:45.860968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3517cc9-b1a4-46c6-8e22-1ed09826fc0e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:45.910007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:45.980695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd495f-a51d-40bb-813a-7d5563c56a03 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:45.992984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 102/201] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:45.997841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3517cc9-b1a4-46c6-8e22-1ed09826fc0e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:46.040748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd931d5-5d19-4fa7-b7ef-166c11591a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:46.041369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd931d5-5d19-4fa7-b7ef-166c11591a9a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:46.041649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd931d5-5d19-4fa7-b7ef-166c11591a9a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:46.041925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd931d5-5d19-4fa7-b7ef-166c11591a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:46.097532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:46.120554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd931d5-5d19-4fa7-b7ef-166c11591a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:46.121930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd931d5-5d19-4fa7-b7ef-166c11591a9a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:46.130904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3517cc9-b1a4-46c6-8e22-1ed09826fc0e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:46.184207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0cd01-d047-43e7-981f-488dea491519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:46.185406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:46.186600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0cd01-d047-43e7-981f-488dea491519 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:46.187100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0cd01-d047-43e7-981f-488dea491519 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:46.187549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0cd01-d047-43e7-981f-488dea491519 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:46.188945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0cd01-d047-43e7-981f-488dea491519 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:46.191727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0cd01-d047-43e7-981f-488dea491519 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:46.198062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 103/202] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:45 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:46.198062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0cd01-d047-43e7-981f-488dea491519 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:46.245067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 100/203] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:46.246240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd931d5-5d19-4fa7-b7ef-166c11591a9a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:46.328349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0cd01-d047-43e7-981f-488dea491519 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:46.368672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49db608-027e-4941-8a30-3a934c2e41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:46.369536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49db608-027e-4941-8a30-3a934c2e41b4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:46.369974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49db608-027e-4941-8a30-3a934c2e41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:46.370504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49db608-027e-4941-8a30-3a934c2e41b4 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:46.371840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49db608-027e-4941-8a30-3a934c2e41b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:46.372449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd931d5-5d19-4fa7-b7ef-166c11591a9a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:46.373628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49db608-027e-4941-8a30-3a934c2e41b4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:46.375526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 104/204] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:46 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:46.376525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49db608-027e-4941-8a30-3a934c2e41b4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:46.401629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:46.424517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50855a19-b17e-4ac2-ab45-31a2a8e02852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:46.425182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50855a19-b17e-4ac2-ab45-31a2a8e02852 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:46.425507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50855a19-b17e-4ac2-ab45-31a2a8e02852 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:46.425775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50855a19-b17e-4ac2-ab45-31a2a8e02852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:46.426510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50855a19-b17e-4ac2-ab45-31a2a8e02852 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=6e41da4162ce4e9e826e0da589f2c640, user.id=21d33a975e494f76a2bcbb4425cfbbc3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:46.427554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50855a19-b17e-4ac2-ab45-31a2a8e02852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:46.429020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50855a19-b17e-4ac2-ab45-31a2a8e02852 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:46.436235 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 101/205] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:46 2022] GET /identity/v3/role_assignments?user.id=21d33a975e494f76a2bcbb4425cfbbc3&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=9ec7f759c0a64655b794dfb597930076 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:46.437945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50855a19-b17e-4ac2-ab45-31a2a8e02852 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:46.476023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:46.553145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49db608-027e-4941-8a30-3a934c2e41b4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:46.621534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65584d-1057-4d6e-883c-009288915c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:46.622433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65584d-1057-4d6e-883c-009288915c94 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:46.622868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65584d-1057-4d6e-883c-009288915c94 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:46.623311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65584d-1057-4d6e-883c-009288915c94 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:46.624619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65584d-1057-4d6e-883c-009288915c94 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:46.627502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65584d-1057-4d6e-883c-009288915c94 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:46.629393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 105/206] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:46 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:46.636942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65584d-1057-4d6e-883c-009288915c94 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:46.649238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50855a19-b17e-4ac2-ab45-31a2a8e02852 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:46.699239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19010f-275b-43c9-9c27-30882e1e5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:46.699876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19010f-275b-43c9-9c27-30882e1e5990 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:46.700155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19010f-275b-43c9-9c27-30882e1e5990 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:46.700425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19010f-275b-43c9-9c27-30882e1e5990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:46.701168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19010f-275b-43c9-9c27-30882e1e5990 None admin] RBAC: Adding query filter params (role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=6e41da4162ce4e9e826e0da589f2c640, user.id=21d33a975e494f76a2bcbb4425cfbbc3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:46.701473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19010f-275b-43c9-9c27-30882e1e5990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:46.702920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19010f-275b-43c9-9c27-30882e1e5990 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:46.722036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 102/207] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:46 2022] GET /identity/v3/role_assignments?user.id=21d33a975e494f76a2bcbb4425cfbbc3&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=25294da9af854bf181e95bc99a9818c8 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:46.797375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:46.835699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65584d-1057-4d6e-883c-009288915c94 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:46.880587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7ab85-3141-4589-a294-5a6a0846a6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:46.881568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7ab85-3141-4589-a294-5a6a0846a6c6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:46.882312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7ab85-3141-4589-a294-5a6a0846a6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:46.882872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7ab85-3141-4589-a294-5a6a0846a6c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:46.883890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7ab85-3141-4589-a294-5a6a0846a6c6 None admin] RBAC: Adding query filter params (role.id=385cdabadee14249a091591e0a2961f2, scope.project.id=5b45f2debc7148b79ed609906b98b179, user.id=0e7038eff5a746e1b07080d0c26355f3) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:46.884417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7ab85-3141-4589-a294-5a6a0846a6c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:46.886209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7ab85-3141-4589-a294-5a6a0846a6c6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:46.893354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 106/208] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:46 2022] GET /identity/v3/role_assignments?user.id=0e7038eff5a746e1b07080d0c26355f3&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=385cdabadee14249a091591e0a2961f2 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:47.317884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2698e7-6d29-4202-8398-2b380e8e20a8 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:47.318258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2698e7-6d29-4202-8398-2b380e8e20a8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:47.318626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2698e7-6d29-4202-8398-2b380e8e20a8 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:47.320332 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 103/209] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:47.326162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875b374-2716-4df1-b421-06b5a2d20602 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:47.327041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875b374-2716-4df1-b421-06b5a2d20602 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:47.327540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875b374-2716-4df1-b421-06b5a2d20602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:47.399247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8875b374-2716-4df1-b421-06b5a2d20602 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:47.399247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8875b374-2716-4df1-b421-06b5a2d20602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:47.472067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6cdc-e3a3-4eac-93e8-f9dff37bc601 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:47.472413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6cdc-e3a3-4eac-93e8-f9dff37bc601 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:47.472641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a6cdc-e3a3-4eac-93e8-f9dff37bc601 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:47.474348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 104/210] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:47.481190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072e703-e1ec-45ef-939a-448f302d5383 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:47.481472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072e703-e1ec-45ef-939a-448f302d5383 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:47.481778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072e703-e1ec-45ef-939a-448f302d5383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:47.487899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 107/211] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:47.503818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8072e703-e1ec-45ef-939a-448f302d5383 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:47.505685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8072e703-e1ec-45ef-939a-448f302d5383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:47.579982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:47.763371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875b374-2716-4df1-b421-06b5a2d20602 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:47.846223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:47.853505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072e703-e1ec-45ef-939a-448f302d5383 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:47.863982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:47.873677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875b374-2716-4df1-b421-06b5a2d20602 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:47.913715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad140b99-d9f0-46b6-9a26-a1e2fa4bd0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:47.914352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad140b99-d9f0-46b6-9a26-a1e2fa4bd0dc None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:47.914625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad140b99-d9f0-46b6-9a26-a1e2fa4bd0dc None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:47.914889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad140b99-d9f0-46b6-9a26-a1e2fa4bd0dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:47.928646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad140b99-d9f0-46b6-9a26-a1e2fa4bd0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-ad140b99-d9f0-46b6-9a26-a1e2fa4bd0dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:47.933619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:47.934520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:47.935353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 108/213] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:47.940693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad140b99-d9f0-46b6-9a26-a1e2fa4bd0dc None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:47.974574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072e703-e1ec-45ef-939a-448f302d5383 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:48.012900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fb15-2a84-440e-90bd-fad468ec35fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:48.013903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fb15-2a84-440e-90bd-fad468ec35fd None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:48.014379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fb15-2a84-440e-90bd-fad468ec35fd None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:48.014861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fb15-2a84-440e-90bd-fad468ec35fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:48.016242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fb15-2a84-440e-90bd-fad468ec35fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:48.017911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fb15-2a84-440e-90bd-fad468ec35fd None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:48.019755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:48.026040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fb15-2a84-440e-90bd-fad468ec35fd None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:48.053918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad140b99-d9f0-46b6-9a26-a1e2fa4bd0dc None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:48.090303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd683-ab19-4689-970c-4d5afb75e6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:48.090910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd683-ab19-4689-970c-4d5afb75e6bf None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:48.091182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd683-ab19-4689-970c-4d5afb75e6bf None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:48.091525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd683-ab19-4689-970c-4d5afb75e6bf None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:48.092256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fd683-ab19-4689-970c-4d5afb75e6bf None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:48.092559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fd683-ab19-4689-970c-4d5afb75e6bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:48.094006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fd683-ab19-4689-970c-4d5afb75e6bf None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:48.096331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:48.104944 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 109/215] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:48.110658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd683-ab19-4689-970c-4d5afb75e6bf None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:48.113411 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:48.139363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fb15-2a84-440e-90bd-fad468ec35fd None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:48.178102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89169634-3ad0-4474-8251-76300264b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:48.179124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89169634-3ad0-4474-8251-76300264b41c None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:48.179615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89169634-3ad0-4474-8251-76300264b41c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:48.180085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89169634-3ad0-4474-8251-76300264b41c None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:48.180936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89169634-3ad0-4474-8251-76300264b41c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:48.182611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89169634-3ad0-4474-8251-76300264b41c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:48.220488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd683-ab19-4689-970c-4d5afb75e6bf None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:48.259761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c96f6f-c175-4449-8740-3204ecb78dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:48.260374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c96f6f-c175-4449-8740-3204ecb78dbe None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:48.260651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c96f6f-c175-4449-8740-3204ecb78dbe None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:48.260922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c96f6f-c175-4449-8740-3204ecb78dbe None admin] PATH_INFO: `/v3/users/9c0d328de5e94beaa1aed5e0fd402095` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:48.279468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c96f6f-c175-4449-8740-3204ecb78dbe None admin] RBAC: Authorizing `identity:get_user(user_id=9c0d328de5e94beaa1aed5e0fd402095)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:48.287262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c96f6f-c175-4449-8740-3204ecb78dbe None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:48.287262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 110/216] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:48 2022] GET /identity/v3/users/9c0d328de5e94beaa1aed5e0fd402095 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:48.288451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 107/217] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:39:48 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:39:48.289101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c96f6f-c175-4449-8740-3204ecb78dbe None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:48.361957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:48.419203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c96f6f-c175-4449-8740-3204ecb78dbe None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:48.459993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee924b0-9931-4937-b4c9-b25773e19426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:48.460606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee924b0-9931-4937-b4c9-b25773e19426 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:48.460881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee924b0-9931-4937-b4c9-b25773e19426 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:48.461149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee924b0-9931-4937-b4c9-b25773e19426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:48.537958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee924b0-9931-4937-b4c9-b25773e19426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:48.539528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee924b0-9931-4937-b4c9-b25773e19426 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:48.600155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:48.650924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 111/218] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 19:39:48.657363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89169634-3ad0-4474-8251-76300264b41c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:48.792073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89169634-3ad0-4474-8251-76300264b41c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:48.834584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:48.840359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a626b55-9d8b-475f-b8f0-c261af700768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:48.841447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a626b55-9d8b-475f-b8f0-c261af700768 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:48.841928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a626b55-9d8b-475f-b8f0-c261af700768 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:48.842395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a626b55-9d8b-475f-b8f0-c261af700768 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:48.844481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a626b55-9d8b-475f-b8f0-c261af700768 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:48.846938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a626b55-9d8b-475f-b8f0-c261af700768 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:48.849778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 108/219] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:48 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:48.854145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0014-4ca5-4bce-bef1-05e850c55e8e None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:48.854424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0014-4ca5-4bce-bef1-05e850c55e8e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:48.854700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e0014-4ca5-4bce-bef1-05e850c55e8e None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:48.856645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 112/220] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:48.856812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a626b55-9d8b-475f-b8f0-c261af700768 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:48.863144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111e17-cca5-4cda-9640-63aaeacb2140 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:48.863454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111e17-cca5-4cda-9640-63aaeacb2140 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:48.863730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc111e17-cca5-4cda-9640-63aaeacb2140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:48.888239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-cc111e17-cca5-4cda-9640-63aaeacb2140 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:48.891925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cc111e17-cca5-4cda-9640-63aaeacb2140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:48.971950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 113/221] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:48.974948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a626b55-9d8b-475f-b8f0-c261af700768 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:48.985263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469030c9-7039-4680-a460-13ca443722f7 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:48.985539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469030c9-7039-4680-a460-13ca443722f7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:48.985811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469030c9-7039-4680-a460-13ca443722f7 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:48.987487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 114/222] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:49.000977 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7edf41-e58f-4173-b072-989d9cfdfd15 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:49.001297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7edf41-e58f-4173-b072-989d9cfdfd15 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:49.001555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7edf41-e58f-4173-b072-989d9cfdfd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:49.021726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05541cd-5842-423d-b374-6ba533b77948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:49.022345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05541cd-5842-423d-b374-6ba533b77948 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:49.022623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05541cd-5842-423d-b374-6ba533b77948 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:49.022886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05541cd-5842-423d-b374-6ba533b77948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:49.023658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05541cd-5842-423d-b374-6ba533b77948 None admin] RBAC: Adding query filter params (role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=6e41da4162ce4e9e826e0da589f2c640, user.id=9c0d328de5e94beaa1aed5e0fd402095) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:49.023962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05541cd-5842-423d-b374-6ba533b77948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:49.025744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05541cd-5842-423d-b374-6ba533b77948 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:49.036055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8f7edf41-e58f-4173-b072-989d9cfdfd15 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:49.037790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8f7edf41-e58f-4173-b072-989d9cfdfd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:49.041718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 109/223] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:48 2022] GET /identity/v3/role_assignments?user.id=9c0d328de5e94beaa1aed5e0fd402095&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:49.148784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 115/224] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:49.457844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05541cd-5842-423d-b374-6ba533b77948 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:49.537392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:49.580877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05541cd-5842-423d-b374-6ba533b77948 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:49.624849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bfd93-d8b2-4e9e-95cc-9a0037e10679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:49.625501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bfd93-d8b2-4e9e-95cc-9a0037e10679 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:49.625779 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bfd93-d8b2-4e9e-95cc-9a0037e10679 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:49.626048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bfd93-d8b2-4e9e-95cc-9a0037e10679 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:49.643536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bfd93-d8b2-4e9e-95cc-9a0037e10679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-483bfd93-d8b2-4e9e-95cc-9a0037e10679 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:49.649858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:49.650780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:49.651621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 110/225] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:39:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:49.657303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7edf41-e58f-4173-b072-989d9cfdfd15 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:49.669782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bfd93-d8b2-4e9e-95cc-9a0037e10679 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:49.689728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:49.847858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7edf41-e58f-4173-b072-989d9cfdfd15 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:49.906704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bfd93-d8b2-4e9e-95cc-9a0037e10679 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:49.928522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb19793-ba08-46ef-bdd3-55f9b64d0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:49.929166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb19793-ba08-46ef-bdd3-55f9b64d0594 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:49.929446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb19793-ba08-46ef-bdd3-55f9b64d0594 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:49.929717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb19793-ba08-46ef-bdd3-55f9b64d0594 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:49.930445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb19793-ba08-46ef-bdd3-55f9b64d0594 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:49.930748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb19793-ba08-46ef-bdd3-55f9b64d0594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:49.932369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb19793-ba08-46ef-bdd3-55f9b64d0594 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:49.949531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 116/226] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:39:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:49.956868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb19793-ba08-46ef-bdd3-55f9b64d0594 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:49.963407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:49.976972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119de141-b1dd-48ca-8c9b-a77b199e899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:49.977627 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119de141-b1dd-48ca-8c9b-a77b199e899f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:49.977903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119de141-b1dd-48ca-8c9b-a77b199e899f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:49.978235 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119de141-b1dd-48ca-8c9b-a77b199e899f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:49.991615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119de141-b1dd-48ca-8c9b-a77b199e899f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-119de141-b1dd-48ca-8c9b-a77b199e899f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:49.996931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:49.997848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:49.998647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:49.999289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 111/227] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:50.008315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119de141-b1dd-48ca-8c9b-a77b199e899f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:50.100683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:50.139751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb19793-ba08-46ef-bdd3-55f9b64d0594 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:50.210702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6a41d-ebf7-4d36-b92d-02fcb927b51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:50.211821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6a41d-ebf7-4d36-b92d-02fcb927b51d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:50.212302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6a41d-ebf7-4d36-b92d-02fcb927b51d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:50.212768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6a41d-ebf7-4d36-b92d-02fcb927b51d None admin] PATH_INFO: `/v3/users/21d33a975e494f76a2bcbb4425cfbbc3` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:50.218881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6a41d-ebf7-4d36-b92d-02fcb927b51d None admin] RBAC: Authorizing `identity:get_user(user_id=21d33a975e494f76a2bcbb4425cfbbc3)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:50.225480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6a41d-ebf7-4d36-b92d-02fcb927b51d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:50.229138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 117/228] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:49 2022] GET /identity/v3/users/21d33a975e494f76a2bcbb4425cfbbc3 => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:50.235585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6a41d-ebf7-4d36-b92d-02fcb927b51d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:50.243250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119de141-b1dd-48ca-8c9b-a77b199e899f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:50.284077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ae0c1-ee48-40d9-b623-cfcea6232b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:50.284705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ae0c1-ee48-40d9-b623-cfcea6232b2b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:50.284977 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ae0c1-ee48-40d9-b623-cfcea6232b2b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:50.285249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ae0c1-ee48-40d9-b623-cfcea6232b2b None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:50.286555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ae0c1-ee48-40d9-b623-cfcea6232b2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:50.287150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ae0c1-ee48-40d9-b623-cfcea6232b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:50.288692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ae0c1-ee48-40d9-b623-cfcea6232b2b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:50.304291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 112/229] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:50.310683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ae0c1-ee48-40d9-b623-cfcea6232b2b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:50.376938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:50.457706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6a41d-ebf7-4d36-b92d-02fcb927b51d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:50.464406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ae0c1-ee48-40d9-b623-cfcea6232b2b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:50.508045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430306f-1d56-4c87-bb60-c5bb6cc26b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:50.509069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430306f-1d56-4c87-bb60-c5bb6cc26b7f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:50.509571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430306f-1d56-4c87-bb60-c5bb6cc26b7f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:50.510111 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430306f-1d56-4c87-bb60-c5bb6cc26b7f None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:50.511630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430306f-1d56-4c87-bb60-c5bb6cc26b7f None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:50.513352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430306f-1d56-4c87-bb60-c5bb6cc26b7f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:50.515698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 118/230] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:50 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:50.523764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430306f-1d56-4c87-bb60-c5bb6cc26b7f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:50.541809 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c215dc-bbdb-4ab6-a013-40fbe7de5535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:50.542852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c215dc-bbdb-4ab6-a013-40fbe7de5535 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:50.543504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c215dc-bbdb-4ab6-a013-40fbe7de5535 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:50.543988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c215dc-bbdb-4ab6-a013-40fbe7de5535 None admin] PATH_INFO: `/v3/users/21d33a975e494f76a2bcbb4425cfbbc3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:50.545615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c215dc-bbdb-4ab6-a013-40fbe7de5535 None admin] RBAC: Authorizing `identity:get_user(user_id=21d33a975e494f76a2bcbb4425cfbbc3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:50.547323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c215dc-bbdb-4ab6-a013-40fbe7de5535 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:50.557050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 113/231] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:50 2022] GET /identity/v3/users/21d33a975e494f76a2bcbb4425cfbbc3 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:50.559323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:50.564772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c215dc-bbdb-4ab6-a013-40fbe7de5535 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:50.673932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430306f-1d56-4c87-bb60-c5bb6cc26b7f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:50.702711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c215dc-bbdb-4ab6-a013-40fbe7de5535 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:50.731696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:50.743946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4462925-c303-43d9-b30e-66d9d3510a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:50.744630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462925-c303-43d9-b30e-66d9d3510a41 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:50.745036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462925-c303-43d9-b30e-66d9d3510a41 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:50.745314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462925-c303-43d9-b30e-66d9d3510a41 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:50.746717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4462925-c303-43d9-b30e-66d9d3510a41 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:50.748234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4462925-c303-43d9-b30e-66d9d3510a41 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:50.750006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 114/232] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:50 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:50.756370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4462925-c303-43d9-b30e-66d9d3510a41 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:50.763920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b748b-fb6f-41a1-b416-9c39877d6602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:50.764603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b748b-fb6f-41a1-b416-9c39877d6602 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:50.764881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b748b-fb6f-41a1-b416-9c39877d6602 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:50.765152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b748b-fb6f-41a1-b416-9c39877d6602 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640/users/21d33a975e494f76a2bcbb4425cfbbc3/roles/25294da9af854bf181e95bc99a9818c8` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:50.767891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b748b-fb6f-41a1-b416-9c39877d6602 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e41da4162ce4e9e826e0da589f2c640, user_id=21d33a975e494f76a2bcbb4425cfbbc3, role_id=25294da9af854bf181e95bc99a9818c8)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:50.769373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b748b-fb6f-41a1-b416-9c39877d6602 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:50.847285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 119/233] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:39:50 2022] PUT /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640/users/21d33a975e494f76a2bcbb4425cfbbc3/roles/25294da9af854bf181e95bc99a9818c8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:39:50.904728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4462925-c303-43d9-b30e-66d9d3510a41 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:50.951019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069b18b-852b-42c3-9e29-792cc7ecfaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:50.951774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069b18b-852b-42c3-9e29-792cc7ecfaf5 None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:50.952019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069b18b-852b-42c3-9e29-792cc7ecfaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:50.952294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069b18b-852b-42c3-9e29-792cc7ecfaf5 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640/users/21d33a975e494f76a2bcbb4425cfbbc3/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:50.954360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069b18b-852b-42c3-9e29-792cc7ecfaf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e41da4162ce4e9e826e0da589f2c640, user_id=21d33a975e494f76a2bcbb4425cfbbc3, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:50.956006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069b18b-852b-42c3-9e29-792cc7ecfaf5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:50.991968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb586-9c78-407c-af39-13a55a5aabc8 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:50.992217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb586-9c78-407c-af39-13a55a5aabc8 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:50.992528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb586-9c78-407c-af39-13a55a5aabc8 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:50.994340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 120/234] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:51.000464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab6dcf-9ed2-4498-9a9e-54d4a8cc0a2d None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:51.000744 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab6dcf-9ed2-4498-9a9e-54d4a8cc0a2d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:51.001021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab6dcf-9ed2-4498-9a9e-54d4a8cc0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:51.023370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-37ab6dcf-9ed2-4498-9a9e-54d4a8cc0a2d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:51.024606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-37ab6dcf-9ed2-4498-9a9e-54d4a8cc0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:51.065847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 115/235] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:39:50 2022] PUT /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640/users/21d33a975e494f76a2bcbb4425cfbbc3/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:39:51.144536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 121/236] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:51.288351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cf9ce-43ea-48d3-87eb-23c675084563 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:51.288697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cf9ce-43ea-48d3-87eb-23c675084563 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:51.288799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cf9ce-43ea-48d3-87eb-23c675084563 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:51.290202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 116/237] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:51.296541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5e682-d96c-4fad-9dd5-b3460b996aab None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:51.305540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5e682-d96c-4fad-9dd5-b3460b996aab None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:51.305540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5e682-d96c-4fad-9dd5-b3460b996aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:51.305540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:51.316515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-24d5e682-d96c-4fad-9dd5-b3460b996aab None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:51.318561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-24d5e682-d96c-4fad-9dd5-b3460b996aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:51.420345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:51.440135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cf9ce-43ea-48d3-87eb-23c675084563 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:51.505907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:51.587862 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cf9ce-43ea-48d3-87eb-23c675084563 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:51.638821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349f394-67db-4c51-a489-b8d408dbc9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:51.639507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349f394-67db-4c51-a489-b8d408dbc9e6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:51.639787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349f394-67db-4c51-a489-b8d408dbc9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:51.640057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349f394-67db-4c51-a489-b8d408dbc9e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:51.655533 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349f394-67db-4c51-a489-b8d408dbc9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-4349f394-67db-4c51-a489-b8d408dbc9e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:51.661522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:51.662984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:51.663886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 117/239] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:51.668868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5e682-d96c-4fad-9dd5-b3460b996aab None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:51.751251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349f394-67db-4c51-a489-b8d408dbc9e6 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:51.818501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5e682-d96c-4fad-9dd5-b3460b996aab None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:51.867456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c520015-d2af-49f7-aa0f-af1c36ce43ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:51.868475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c520015-d2af-49f7-aa0f-af1c36ce43ab None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:51.870250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c520015-d2af-49f7-aa0f-af1c36ce43ab None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:51.871418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c520015-d2af-49f7-aa0f-af1c36ce43ab None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:51.872356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c520015-d2af-49f7-aa0f-af1c36ce43ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:51.872806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c520015-d2af-49f7-aa0f-af1c36ce43ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:51.874376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c520015-d2af-49f7-aa0f-af1c36ce43ab None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:51.876445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:51.885900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 123/240] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:51.887844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab584ad8-1c60-4016-a0ec-a6ef77272833 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:51.888352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab584ad8-1c60-4016-a0ec-a6ef77272833 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:51.888807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab584ad8-1c60-4016-a0ec-a6ef77272833 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:51.890794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 124/241] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:51.893406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349f394-67db-4c51-a489-b8d408dbc9e6 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:51.896947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:51.898261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab584ad8-1c60-4016-a0ec-a6ef77272833 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:51.942803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d4ac8-3a78-4c46-973b-c54901b7a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:51.943467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d4ac8-3a78-4c46-973b-c54901b7a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:51.943746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d4ac8-3a78-4c46-973b-c54901b7a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:51.944019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d4ac8-3a78-4c46-973b-c54901b7a1f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:51.945176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d4ac8-3a78-4c46-973b-c54901b7a1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:51.947359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d4ac8-3a78-4c46-973b-c54901b7a1f5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:51.954598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 118/242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:51.956276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c3bb9-2fca-47d4-9fed-d84c9dcdec28 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:51.956567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c3bb9-2fca-47d4-9fed-d84c9dcdec28 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:51.956840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c3bb9-2fca-47d4-9fed-d84c9dcdec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:51.979719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-670c3bb9-2fca-47d4-9fed-d84c9dcdec28 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:51.981277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-670c3bb9-2fca-47d4-9fed-d84c9dcdec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:52.029039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab584ad8-1c60-4016-a0ec-a6ef77272833 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:52.063542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 119/243] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:52.064839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c3bb9-2fca-47d4-9fed-d84c9dcdec28 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:52.066027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549db0b-0862-40e3-bc9f-aefd6b5b45d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:52.066670 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549db0b-0862-40e3-bc9f-aefd6b5b45d9 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:52.066951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549db0b-0862-40e3-bc9f-aefd6b5b45d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:52.067952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549db0b-0862-40e3-bc9f-aefd6b5b45d9 None admin] PATH_INFO: `/v3/users/4f2e24532712433f85f869d0fbc834e1` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:52.082597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549db0b-0862-40e3-bc9f-aefd6b5b45d9 None admin] RBAC: Authorizing `identity:get_user(user_id=4f2e24532712433f85f869d0fbc834e1)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:52.086968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549db0b-0862-40e3-bc9f-aefd6b5b45d9 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:52.086968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 125/244] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:51 2022] GET /identity/v3/users/4f2e24532712433f85f869d0fbc834e1 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:52.096189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549db0b-0862-40e3-bc9f-aefd6b5b45d9 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:52.212331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:52.216095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c3bb9-2fca-47d4-9fed-d84c9dcdec28 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:52.225142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:52.255723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c829f8-d6fb-45f3-84f7-1f8ce7f9984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:52.256913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c829f8-d6fb-45f3-84f7-1f8ce7f9984e None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:52.257416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c829f8-d6fb-45f3-84f7-1f8ce7f9984e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:52.257863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c829f8-d6fb-45f3-84f7-1f8ce7f9984e None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:52.258810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c829f8-d6fb-45f3-84f7-1f8ce7f9984e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:52.260498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c829f8-d6fb-45f3-84f7-1f8ce7f9984e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:52.308346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549db0b-0862-40e3-bc9f-aefd6b5b45d9 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:52.342069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 120/245] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:39:52 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:52.359085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e9107-02b0-4a36-bc42-0c7fd2a29e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:52.360190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e9107-02b0-4a36-bc42-0c7fd2a29e30 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:52.360730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e9107-02b0-4a36-bc42-0c7fd2a29e30 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:52.361237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e9107-02b0-4a36-bc42-0c7fd2a29e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:52.390467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c829f8-d6fb-45f3-84f7-1f8ce7f9984e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:52.503323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e9107-02b0-4a36-bc42-0c7fd2a29e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:52.505306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e9107-02b0-4a36-bc42-0c7fd2a29e30 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:52.542279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c829f8-d6fb-45f3-84f7-1f8ce7f9984e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:52.592856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406c1d-0373-4ba0-8010-1da7285b1728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:52.594057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406c1d-0373-4ba0-8010-1da7285b1728 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:52.594647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406c1d-0373-4ba0-8010-1da7285b1728 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:52.595719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406c1d-0373-4ba0-8010-1da7285b1728 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:52.607894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:52.613565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406c1d-0373-4ba0-8010-1da7285b1728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-5b406c1d-0373-4ba0-8010-1da7285b1728 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:52.620480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:52.629514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 121/246] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:39:52.630853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406c1d-0373-4ba0-8010-1da7285b1728 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:52.662077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:52.685681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 126/247] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:52.693950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e9107-02b0-4a36-bc42-0c7fd2a29e30 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:52.788160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406c1d-0373-4ba0-8010-1da7285b1728 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:52.854942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e9107-02b0-4a36-bc42-0c7fd2a29e30 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:52.863905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc0514-7653-4362-ac50-96eeef6bd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:52.865001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc0514-7653-4362-ac50-96eeef6bd403 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:52.865271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc0514-7653-4362-ac50-96eeef6bd403 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:52.865534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc0514-7653-4362-ac50-96eeef6bd403 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:52.866223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc0514-7653-4362-ac50-96eeef6bd403 None admin] RBAC: Adding query filter params (name=member) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:52.866520 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc0514-7653-4362-ac50-96eeef6bd403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:52.867960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc0514-7653-4362-ac50-96eeef6bd403 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:52.882814 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 122/248] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:52.893990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc0514-7653-4362-ac50-96eeef6bd403 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:52.927744 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8dd0f-9430-4eca-93cb-abe01bbbb4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:52.928764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8dd0f-9430-4eca-93cb-abe01bbbb4db None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:52.929180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8dd0f-9430-4eca-93cb-abe01bbbb4db None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:52.930022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8dd0f-9430-4eca-93cb-abe01bbbb4db None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:52.933187 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8dd0f-9430-4eca-93cb-abe01bbbb4db None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:52.935976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8dd0f-9430-4eca-93cb-abe01bbbb4db None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:52.938073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 127/249] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:52 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:52.949925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8dd0f-9430-4eca-93cb-abe01bbbb4db None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:52.993202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:53.010810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:53.035271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc0514-7653-4362-ac50-96eeef6bd403 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:53.080563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8dd0f-9430-4eca-93cb-abe01bbbb4db None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:53.081431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a405d-1b22-42e1-85ca-85d04a8bfc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:53.082361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a405d-1b22-42e1-85ca-85d04a8bfc72 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:53.083392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a405d-1b22-42e1-85ca-85d04a8bfc72 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:53.083832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a405d-1b22-42e1-85ca-85d04a8bfc72 None admin] PATH_INFO: `/v3/users/9c0d328de5e94beaa1aed5e0fd402095` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:53.085723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a405d-1b22-42e1-85ca-85d04a8bfc72 None admin] RBAC: Authorizing `identity:get_user(user_id=9c0d328de5e94beaa1aed5e0fd402095)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:53.087422 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a405d-1b22-42e1-85ca-85d04a8bfc72 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:53.089346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 123/250] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:52 2022] GET /identity/v3/users/9c0d328de5e94beaa1aed5e0fd402095 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:53.096781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a405d-1b22-42e1-85ca-85d04a8bfc72 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:53.128526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136d825-adca-49bb-8ffc-081df9430a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:53.129300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136d825-adca-49bb-8ffc-081df9430a82 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:53.130776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136d825-adca-49bb-8ffc-081df9430a82 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:53.131164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136d825-adca-49bb-8ffc-081df9430a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:53.132660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136d825-adca-49bb-8ffc-081df9430a82 None admin] RBAC: Adding query filter params (role.id=385cdabadee14249a091591e0a2961f2, scope.project.id=6e41da4162ce4e9e826e0da589f2c640, user.id=4f2e24532712433f85f869d0fbc834e1) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:53.133077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136d825-adca-49bb-8ffc-081df9430a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:53.134876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136d825-adca-49bb-8ffc-081df9430a82 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:53.142819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 128/251] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:52 2022] GET /identity/v3/role_assignments?user.id=4f2e24532712433f85f869d0fbc834e1&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=385cdabadee14249a091591e0a2961f2 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:53.244409 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a405d-1b22-42e1-85ca-85d04a8bfc72 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:53.293006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205095a2-5364-4307-bf28-5001bfdf44f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:53.310501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205095a2-5364-4307-bf28-5001bfdf44f0 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:53.310501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205095a2-5364-4307-bf28-5001bfdf44f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:53.310501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205095a2-5364-4307-bf28-5001bfdf44f0 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:53.310501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205095a2-5364-4307-bf28-5001bfdf44f0 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:53.310501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205095a2-5364-4307-bf28-5001bfdf44f0 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:53.310501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 124/252] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:53 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:53.311015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136d825-adca-49bb-8ffc-081df9430a82 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:53.383460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f5952-ea34-4ff6-b18f-b712d7c74226 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:53.384010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f5952-ea34-4ff6-b18f-b712d7c74226 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:53.384511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f5952-ea34-4ff6-b18f-b712d7c74226 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:53.386543 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 125/253] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:53.392207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f5946-c85d-4ca0-8ff9-40626a59fe4f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:53.392823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f5946-c85d-4ca0-8ff9-40626a59fe4f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:53.393318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f5946-c85d-4ca0-8ff9-40626a59fe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:53.444036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7b0f5946-c85d-4ca0-8ff9-40626a59fe4f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:53.445579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7b0f5946-c85d-4ca0-8ff9-40626a59fe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:53.452903 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:53.469577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:53.473044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136d825-adca-49bb-8ffc-081df9430a82 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:53.526595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f78c4c-0a44-4b92-960c-8df13846e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:53.527414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f78c4c-0a44-4b92-960c-8df13846e61a None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:53.527702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f78c4c-0a44-4b92-960c-8df13846e61a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:53.527983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f78c4c-0a44-4b92-960c-8df13846e61a None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640/users/9c0d328de5e94beaa1aed5e0fd402095/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:53.529979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f78c4c-0a44-4b92-960c-8df13846e61a None admin] RBAC: Authorizing `identity:create_grant(project_id=6e41da4162ce4e9e826e0da589f2c640, user_id=9c0d328de5e94beaa1aed5e0fd402095, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:53.531492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f78c4c-0a44-4b92-960c-8df13846e61a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:53.593562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 126/254] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:53.626949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 129/255] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:39:53 2022] PUT /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640/users/9c0d328de5e94beaa1aed5e0fd402095/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:39:53.912517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f5946-c85d-4ca0-8ff9-40626a59fe4f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:53.917359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a83c3-f66a-46b7-b075-207802d51ca8 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:53.917815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a83c3-f66a-46b7-b075-207802d51ca8 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:53.917903 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a83c3-f66a-46b7-b075-207802d51ca8 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:53.919434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 130/256] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:53.924276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93b5d-d774-4ba9-b139-ec9993486bb6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:53.924565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93b5d-d774-4ba9-b139-ec9993486bb6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:53.924845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93b5d-d774-4ba9-b139-ec9993486bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:53.951521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-40f93b5d-d774-4ba9-b139-ec9993486bb6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:53.953031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-40f93b5d-d774-4ba9-b139-ec9993486bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:54.080957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f5946-c85d-4ca0-8ff9-40626a59fe4f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:54.093617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 131/257] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:54.135920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889208d2-77c6-4fb8-8a34-cb27464ad94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:54.136986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889208d2-77c6-4fb8-8a34-cb27464ad94b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:54.137461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889208d2-77c6-4fb8-8a34-cb27464ad94b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:54.137930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889208d2-77c6-4fb8-8a34-cb27464ad94b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:54.152136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889208d2-77c6-4fb8-8a34-cb27464ad94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-889208d2-77c6-4fb8-8a34-cb27464ad94b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:54.157299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:54.158152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:39:54.158947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:54.161560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 127/258] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:39:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:54.167239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f93b5d-d774-4ba9-b139-ec9993486bb6 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:54.290321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:54.321540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f93b5d-d774-4ba9-b139-ec9993486bb6 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:54.366283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43f05f-4471-40aa-9576-0a0cec5e6924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:54.366901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43f05f-4471-40aa-9576-0a0cec5e6924 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:54.367178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43f05f-4471-40aa-9576-0a0cec5e6924 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:54.367474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43f05f-4471-40aa-9576-0a0cec5e6924 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:54.368163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43f05f-4471-40aa-9576-0a0cec5e6924 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:54.368458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43f05f-4471-40aa-9576-0a0cec5e6924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:54.369863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43f05f-4471-40aa-9576-0a0cec5e6924 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:54.383499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 132/259] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:39:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:54.389379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889208d2-77c6-4fb8-8a34-cb27464ad94b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:54.403653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:54.525458 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889208d2-77c6-4fb8-8a34-cb27464ad94b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:54.576219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d136d3e-710a-47b9-b1bc-282c5c3f40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:54.577789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d136d3e-710a-47b9-b1bc-282c5c3f40dc None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:54.578548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d136d3e-710a-47b9-b1bc-282c5c3f40dc None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:54.579392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d136d3e-710a-47b9-b1bc-282c5c3f40dc None admin] PATH_INFO: `/v3/users/21d33a975e494f76a2bcbb4425cfbbc3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:54.583632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d136d3e-710a-47b9-b1bc-282c5c3f40dc None admin] RBAC: Authorizing `identity:get_user(user_id=21d33a975e494f76a2bcbb4425cfbbc3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:54.586761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d136d3e-710a-47b9-b1bc-282c5c3f40dc None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:54.590642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 128/260] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:54 2022] GET /identity/v3/users/21d33a975e494f76a2bcbb4425cfbbc3 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:54.595968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43f05f-4471-40aa-9576-0a0cec5e6924 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:54.633285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d136d3e-710a-47b9-b1bc-282c5c3f40dc None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:54.751607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:54.806869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d136d3e-710a-47b9-b1bc-282c5c3f40dc None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:54.818104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43f05f-4471-40aa-9576-0a0cec5e6924 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:54.870008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ea4ce-4a7a-479a-baf6-cff5a59f321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:54.871311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ea4ce-4a7a-479a-baf6-cff5a59f321e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:54.872479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ea4ce-4a7a-479a-baf6-cff5a59f321e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:54.873098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ea4ce-4a7a-479a-baf6-cff5a59f321e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:54.889245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cb79f-e661-466f-bcb6-df68d26406cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:54.892377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cb79f-e661-466f-bcb6-df68d26406cd None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:54.895044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cb79f-e661-466f-bcb6-df68d26406cd None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:54.896176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cb79f-e661-466f-bcb6-df68d26406cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:54.898177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ea4ce-4a7a-479a-baf6-cff5a59f321e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-ba7ea4ce-4a7a-479a-baf6-cff5a59f321e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:54.904990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:54.905903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:39:54.906761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:54.915325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 129/261] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:39:54.915998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:54.921369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ea4ce-4a7a-479a-baf6-cff5a59f321e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:55.031863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cb79f-e661-466f-bcb6-df68d26406cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:55.034059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cb79f-e661-466f-bcb6-df68d26406cd None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:55.092482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ea4ce-4a7a-479a-baf6-cff5a59f321e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:55.128002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:55.144462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e95e26-e229-41f8-a2a5-1b0a41b01b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:55.145714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e95e26-e229-41f8-a2a5-1b0a41b01b6c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:55.146195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e95e26-e229-41f8-a2a5-1b0a41b01b6c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:55.146659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e95e26-e229-41f8-a2a5-1b0a41b01b6c None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:55.147700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e95e26-e229-41f8-a2a5-1b0a41b01b6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:55.148280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e95e26-e229-41f8-a2a5-1b0a41b01b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:55.152207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e95e26-e229-41f8-a2a5-1b0a41b01b6c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:55.167776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 130/262] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:55.173025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e95e26-e229-41f8-a2a5-1b0a41b01b6c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:55.238240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 133/263] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:55.244841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cb79f-e661-466f-bcb6-df68d26406cd None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:55.342288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e95e26-e229-41f8-a2a5-1b0a41b01b6c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:55.376742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:55.390564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd607-b89b-4e01-8572-d4a12df0ef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:55.391590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd607-b89b-4e01-8572-d4a12df0ef62 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:55.392337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd607-b89b-4e01-8572-d4a12df0ef62 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:55.392733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd607-b89b-4e01-8572-d4a12df0ef62 None admin] PATH_INFO: `/v3/users/21d33a975e494f76a2bcbb4425cfbbc3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:55.394269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bd607-b89b-4e01-8572-d4a12df0ef62 None admin] RBAC: Authorizing `identity:get_user(user_id=21d33a975e494f76a2bcbb4425cfbbc3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:55.396944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bd607-b89b-4e01-8572-d4a12df0ef62 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:55.399305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 131/264] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:55 2022] GET /identity/v3/users/21d33a975e494f76a2bcbb4425cfbbc3 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:55.408248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd607-b89b-4e01-8572-d4a12df0ef62 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:55.505103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cb79f-e661-466f-bcb6-df68d26406cd None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:55.548687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:55.573405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec15a02-43d8-483a-844f-0754b56a8be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:55.574067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec15a02-43d8-483a-844f-0754b56a8be5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:55.574350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec15a02-43d8-483a-844f-0754b56a8be5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:55.574625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec15a02-43d8-483a-844f-0754b56a8be5 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:55.575837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec15a02-43d8-483a-844f-0754b56a8be5 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:55.577311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec15a02-43d8-483a-844f-0754b56a8be5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:55.583728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 134/265] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:55 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:55.588060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec15a02-43d8-483a-844f-0754b56a8be5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:55.592279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd607-b89b-4e01-8572-d4a12df0ef62 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:55.629080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7c266-c72e-4ed3-a7ab-b5422ea32b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:55.630217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7c266-c72e-4ed3-a7ab-b5422ea32b37 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:55.630499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7c266-c72e-4ed3-a7ab-b5422ea32b37 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:55.630763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7c266-c72e-4ed3-a7ab-b5422ea32b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:55.704559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7c266-c72e-4ed3-a7ab-b5422ea32b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:55.706696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7c266-c72e-4ed3-a7ab-b5422ea32b37 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:55.777067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:55.795353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec15a02-43d8-483a-844f-0754b56a8be5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:55.831657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:55.836336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4574d-78cd-48f0-b810-3ff41050dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:55.836948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4574d-78cd-48f0-b810-3ff41050dbdb None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:55.837234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4574d-78cd-48f0-b810-3ff41050dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:55.837509 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4574d-78cd-48f0-b810-3ff41050dbdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:55.838255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4574d-78cd-48f0-b810-3ff41050dbdb None admin] RBAC: Adding query filter params (role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=6e41da4162ce4e9e826e0da589f2c640, user.id=21d33a975e494f76a2bcbb4425cfbbc3) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:55.838565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4574d-78cd-48f0-b810-3ff41050dbdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:55.842742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4574d-78cd-48f0-b810-3ff41050dbdb None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:55.853460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 132/266] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:55.854741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 135/267] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:55 2022] GET /identity/v3/role_assignments?user.id=21d33a975e494f76a2bcbb4425cfbbc3&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=25294da9af854bf181e95bc99a9818c8 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:55.856223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1923-44ef-45f6-a136-2f630d5ffc98 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:55.856703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1923-44ef-45f6-a136-2f630d5ffc98 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:55.857152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1923-44ef-45f6-a136-2f630d5ffc98 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:55.858812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 136/268] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:55.863373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d9898-6507-41ac-8a53-0fafa8bc8d65 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:55.864378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d9898-6507-41ac-8a53-0fafa8bc8d65 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:55.864682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d9898-6507-41ac-8a53-0fafa8bc8d65 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:55.866663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1923-44ef-45f6-a136-2f630d5ffc98 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:55.866848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 133/269] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:55.868086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb7fb2-cc6f-410c-a1d8-91b706526a57 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:55.868367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb7fb2-cc6f-410c-a1d8-91b706526a57 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:55.868638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb7fb2-cc6f-410c-a1d8-91b706526a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:55.904850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-dbcb7fb2-cc6f-410c-a1d8-91b706526a57 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:55.908366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dbcb7fb2-cc6f-410c-a1d8-91b706526a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:56.062430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 134/270] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:56.064007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fb756-717f-4ac2-baf5-cda522064184 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.064296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fb756-717f-4ac2-baf5-cda522064184 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.064569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fb756-717f-4ac2-baf5-cda522064184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.088857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6f3fb756-717f-4ac2-baf5-cda522064184 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:56.090091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6f3fb756-717f-4ac2-baf5-cda522064184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:56.120022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1923-44ef-45f6-a136-2f630d5ffc98 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:56.177857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 135/271] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:56.183969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3bcdc-1a04-4bd9-a3b7-b37f9d588579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:56.184641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3bcdc-1a04-4bd9-a3b7-b37f9d588579 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.184922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3bcdc-1a04-4bd9-a3b7-b37f9d588579 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.185193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3bcdc-1a04-4bd9-a3b7-b37f9d588579 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.187543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3bcdc-1a04-4bd9-a3b7-b37f9d588579 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:56.189130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3bcdc-1a04-4bd9-a3b7-b37f9d588579 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:56.191805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 137/272] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:55 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:56.198159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fb756-717f-4ac2-baf5-cda522064184 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:56.237944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:56.349730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fb756-717f-4ac2-baf5-cda522064184 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:56.367913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3bcdc-1a04-4bd9-a3b7-b37f9d588579 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:56.422619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3fa76-d71a-4b8a-9518-2a6f6f2196bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:56.423270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3fa76-d71a-4b8a-9518-2a6f6f2196bd None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.423550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3fa76-d71a-4b8a-9518-2a6f6f2196bd None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.423820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3fa76-d71a-4b8a-9518-2a6f6f2196bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.424567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3fa76-d71a-4b8a-9518-2a6f6f2196bd None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=6e41da4162ce4e9e826e0da589f2c640, user.id=21d33a975e494f76a2bcbb4425cfbbc3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:56.424870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3fa76-d71a-4b8a-9518-2a6f6f2196bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:56.426370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3fa76-d71a-4b8a-9518-2a6f6f2196bd None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:56.443305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 136/273] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:56 2022] GET /identity/v3/role_assignments?user.id=21d33a975e494f76a2bcbb4425cfbbc3&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=9ec7f759c0a64655b794dfb597930076 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:56.449264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:56.524803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3bcdc-1a04-4bd9-a3b7-b37f9d588579 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:56.536683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2c07-67da-4279-ba4f-c6fe7d0d8f44 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.537304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2c07-67da-4279-ba4f-c6fe7d0d8f44 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.537304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2c07-67da-4279-ba4f-c6fe7d0d8f44 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.538565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 137/274] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:39:56.539813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e38ffe-cef3-4167-a34b-9b8f3314c7d0 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.540093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e38ffe-cef3-4167-a34b-9b8f3314c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.540508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e38ffe-cef3-4167-a34b-9b8f3314c7d0 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.541892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 138/275] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:56.547617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b469a-1bed-47c2-881e-bac7e96abc8a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.547927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b469a-1bed-47c2-881e-bac7e96abc8a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.548174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b469a-1bed-47c2-881e-bac7e96abc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.572441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56065a65-5952-4295-918f-9b7dfcd2aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:56.573101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56065a65-5952-4295-918f-9b7dfcd2aa9f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.573429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56065a65-5952-4295-918f-9b7dfcd2aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.573656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56065a65-5952-4295-918f-9b7dfcd2aa9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.574383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f56b469a-1bed-47c2-881e-bac7e96abc8a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:56.574859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56065a65-5952-4295-918f-9b7dfcd2aa9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:56.575691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f56b469a-1bed-47c2-881e-bac7e96abc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:56.576418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56065a65-5952-4295-918f-9b7dfcd2aa9f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:56.578157 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 138/276] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:56.580163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a591-a03e-4149-9df2-421eeb15e3ad None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.580163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a591-a03e-4149-9df2-421eeb15e3ad None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.580163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a591-a03e-4149-9df2-421eeb15e3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.603803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-79a2a591-a03e-4149-9df2-421eeb15e3ad None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:56.605133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-79a2a591-a03e-4149-9df2-421eeb15e3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:56.668471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 139/277] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:56.672620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b469a-1bed-47c2-881e-bac7e96abc8a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:56.688795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 139/278] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:56.689482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2a591-a03e-4149-9df2-421eeb15e3ad None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:56.702157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:56.734270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:56.811092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b469a-1bed-47c2-881e-bac7e96abc8a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:56.824048 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2a591-a03e-4149-9df2-421eeb15e3ad None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:56.847320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1d61b-1ef6-4d47-9e35-eca40e1daabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:56.847951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1d61b-1ef6-4d47-9e35-eca40e1daabe None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.848870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1d61b-1ef6-4d47-9e35-eca40e1daabe None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.849166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1d61b-1ef6-4d47-9e35-eca40e1daabe None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.849889 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1d61b-1ef6-4d47-9e35-eca40e1daabe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:56.851866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1d61b-1ef6-4d47-9e35-eca40e1daabe None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:56.871483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e4301-17a8-4cd4-bef8-2d7a858fc9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:56.877564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4301-17a8-4cd4-bef8-2d7a858fc9e5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:56.877564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4301-17a8-4cd4-bef8-2d7a858fc9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:56.877564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e4301-17a8-4cd4-bef8-2d7a858fc9e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:56.890765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e4301-17a8-4cd4-bef8-2d7a858fc9e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-001e4301-17a8-4cd4-bef8-2d7a858fc9e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:56.895984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:56.897086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:56.898671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:56.899934 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 140/279] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:56.904708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e4301-17a8-4cd4-bef8-2d7a858fc9e5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:56.952760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 140/280] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:39:56 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:39:56.984545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1d61b-1ef6-4d47-9e35-eca40e1daabe None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.033952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:57.040639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e4301-17a8-4cd4-bef8-2d7a858fc9e5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.074504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:57.081460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef840d7e-fa4a-4682-9b2e-ad3d7fbe429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.082084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840d7e-fa4a-4682-9b2e-ad3d7fbe429f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.082684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840d7e-fa4a-4682-9b2e-ad3d7fbe429f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.082790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef840d7e-fa4a-4682-9b2e-ad3d7fbe429f None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:57.084227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef840d7e-fa4a-4682-9b2e-ad3d7fbe429f None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:57.088106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef840d7e-fa4a-4682-9b2e-ad3d7fbe429f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:57.088106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef840d7e-fa4a-4682-9b2e-ad3d7fbe429f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:57.096000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 141/281] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:57.100198 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef840d7e-fa4a-4682-9b2e-ad3d7fbe429f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.109451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1d61b-1ef6-4d47-9e35-eca40e1daabe None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.152616 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a4b68-52b1-4823-bbe2-39ecccc0e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.153343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a4b68-52b1-4823-bbe2-39ecccc0e076 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.153560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a4b68-52b1-4823-bbe2-39ecccc0e076 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.153831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a4b68-52b1-4823-bbe2-39ecccc0e076 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:57.165848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a4b68-52b1-4823-bbe2-39ecccc0e076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-438a4b68-52b1-4823-bbe2-39ecccc0e076 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:57.172169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:57.173232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:39:57.174026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:39:57.178617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 141/282] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:57.179880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a4b68-52b1-4823-bbe2-39ecccc0e076 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.230604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef840d7e-fa4a-4682-9b2e-ad3d7fbe429f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.277435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ae854-3906-4c4c-8505-afaf9d87d68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.278441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae854-3906-4c4c-8505-afaf9d87d68b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.278722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae854-3906-4c4c-8505-afaf9d87d68b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.278994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae854-3906-4c4c-8505-afaf9d87d68b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:57.296981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ae854-3906-4c4c-8505-afaf9d87d68b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-839ae854-3906-4c4c-8505-afaf9d87d68b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:39:57.303472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:39:57.310698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 142/283] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:39:57.311618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ae854-3906-4c4c-8505-afaf9d87d68b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.317077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a4b68-52b1-4823-bbe2-39ecccc0e076 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.333075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:57.352339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:57.358123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626d229-5055-41e9-bfd9-15e31462adc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.358845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626d229-5055-41e9-bfd9-15e31462adc3 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.359178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626d229-5055-41e9-bfd9-15e31462adc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.359497 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626d229-5055-41e9-bfd9-15e31462adc3 None admin] PATH_INFO: `/v3/users/4f7abb1c6bc54cd9bf45b0b4f83e0c42` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:57.376370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626d229-5055-41e9-bfd9-15e31462adc3 None admin] RBAC: Authorizing `identity:get_user(user_id=4f7abb1c6bc54cd9bf45b0b4f83e0c42)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:57.378583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626d229-5055-41e9-bfd9-15e31462adc3 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:57.381215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 142/284] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:57 2022] GET /identity/v3/users/4f7abb1c6bc54cd9bf45b0b4f83e0c42 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:57.382086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626d229-5055-41e9-bfd9-15e31462adc3 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.437916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ae854-3906-4c4c-8505-afaf9d87d68b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.483762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb16b2c-c92e-4138-829a-2461cd5b3362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.485111 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb16b2c-c92e-4138-829a-2461cd5b3362 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.485969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb16b2c-c92e-4138-829a-2461cd5b3362 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.487605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb16b2c-c92e-4138-829a-2461cd5b3362 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:57.490056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb16b2c-c92e-4138-829a-2461cd5b3362 None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:57.491130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb16b2c-c92e-4138-829a-2461cd5b3362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:57.495364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb16b2c-c92e-4138-829a-2461cd5b3362 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:57.517121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 143/285] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:57.519785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb16b2c-c92e-4138-829a-2461cd5b3362 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.528783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626d229-5055-41e9-bfd9-15e31462adc3 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.571839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80234ef2-4048-4b72-aec9-82fd7d9f526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.573475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80234ef2-4048-4b72-aec9-82fd7d9f526b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.573975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80234ef2-4048-4b72-aec9-82fd7d9f526b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.574460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80234ef2-4048-4b72-aec9-82fd7d9f526b None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:57.575771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80234ef2-4048-4b72-aec9-82fd7d9f526b None admin] RBAC: Adding query filter params (name=reader) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:57.576330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80234ef2-4048-4b72-aec9-82fd7d9f526b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:57.579287 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80234ef2-4048-4b72-aec9-82fd7d9f526b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:57.591116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 143/286] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:39:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:57.591980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80234ef2-4048-4b72-aec9-82fd7d9f526b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.662846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:57.672112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb16b2c-c92e-4138-829a-2461cd5b3362 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.675558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:57.716771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a41950-f465-4dcf-ac07-47bdcecaaaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.717185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80234ef2-4048-4b72-aec9-82fd7d9f526b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.717399 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a41950-f465-4dcf-ac07-47bdcecaaaa4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.717682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a41950-f465-4dcf-ac07-47bdcecaaaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.717990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a41950-f465-4dcf-ac07-47bdcecaaaa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:57.718729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a41950-f465-4dcf-ac07-47bdcecaaaa4 None admin] RBAC: Adding query filter params (role.id=62d0acf1402140c5a97def31e7b912c7, user.id=4f7abb1c6bc54cd9bf45b0b4f83e0c42, scope.system=all) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:57.719033 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a41950-f465-4dcf-ac07-47bdcecaaaa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:57.720522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a41950-f465-4dcf-ac07-47bdcecaaaa4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:57.726772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 144/287] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Aug 22 19:39:57 2022] GET /identity/v3/role_assignments?user.id=4f7abb1c6bc54cd9bf45b0b4f83e0c42&scope.system=all&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:57.728016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a41950-f465-4dcf-ac07-47bdcecaaaa4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.758540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5216-8851-4ca5-9fb6-dae511aa3e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.759486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5216-8851-4ca5-9fb6-dae511aa3e1a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.759978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5216-8851-4ca5-9fb6-dae511aa3e1a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.760527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5216-8851-4ca5-9fb6-dae511aa3e1a None admin] PATH_INFO: `/v3/users/9c0d328de5e94beaa1aed5e0fd402095` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:57.761990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd5216-8851-4ca5-9fb6-dae511aa3e1a None admin] RBAC: Authorizing `identity:get_user(user_id=9c0d328de5e94beaa1aed5e0fd402095)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:57.763765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd5216-8851-4ca5-9fb6-dae511aa3e1a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:57.765823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 144/288] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:57 2022] GET /identity/v3/users/9c0d328de5e94beaa1aed5e0fd402095 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:57.775244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5216-8851-4ca5-9fb6-dae511aa3e1a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.853877 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a41950-f465-4dcf-ac07-47bdcecaaaa4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.923948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae60fe1-62b4-4c69-996f-d53136350738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.924600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae60fe1-62b4-4c69-996f-d53136350738 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.924875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae60fe1-62b4-4c69-996f-d53136350738 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.925144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae60fe1-62b4-4c69-996f-d53136350738 None admin] PATH_INFO: `/v3/users/4f2e24532712433f85f869d0fbc834e1` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:57.927976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae60fe1-62b4-4c69-996f-d53136350738 None admin] RBAC: Authorizing `identity:get_user(user_id=4f2e24532712433f85f869d0fbc834e1)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:57.929442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae60fe1-62b4-4c69-996f-d53136350738 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:57.931686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:39:57 2022] GET /identity/v3/users/4f2e24532712433f85f869d0fbc834e1 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:57.936694 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae60fe1-62b4-4c69-996f-d53136350738 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:57.957229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5216-8851-4ca5-9fb6-dae511aa3e1a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:57.971762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:57.983624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:57.995966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba6410-aa57-4d0e-9d39-55d7c92608db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:57.997013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba6410-aa57-4d0e-9d39-55d7c92608db None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:57.997495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba6410-aa57-4d0e-9d39-55d7c92608db None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:57.997995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba6410-aa57-4d0e-9d39-55d7c92608db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:58.091379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae60fe1-62b4-4c69-996f-d53136350738 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:58.095259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba6410-aa57-4d0e-9d39-55d7c92608db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:58.097001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba6410-aa57-4d0e-9d39-55d7c92608db None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:58.126143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d62db-24a4-4761-a3ad-05ed8f672714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:58.126770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d62db-24a4-4761-a3ad-05ed8f672714 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:58.127054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d62db-24a4-4761-a3ad-05ed8f672714 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:58.127363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d62db-24a4-4761-a3ad-05ed8f672714 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:58.131253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d62db-24a4-4761-a3ad-05ed8f672714 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:58.131253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d62db-24a4-4761-a3ad-05ed8f672714 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:58.132359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 146/290] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:57 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:39:58.137915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d62db-24a4-4761-a3ad-05ed8f672714 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:58.231370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:58.255289 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d62db-24a4-4761-a3ad-05ed8f672714 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:58.309403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cedcde-c77a-4e0d-a1a1-a873e4cbdaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:58.310080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cedcde-c77a-4e0d-a1a1-a873e4cbdaf1 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:58.310354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cedcde-c77a-4e0d-a1a1-a873e4cbdaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:58.310620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cedcde-c77a-4e0d-a1a1-a873e4cbdaf1 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640/users/4f2e24532712433f85f869d0fbc834e1/roles/385cdabadee14249a091591e0a2961f2` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:58.314924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cedcde-c77a-4e0d-a1a1-a873e4cbdaf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e41da4162ce4e9e826e0da589f2c640, user_id=4f2e24532712433f85f869d0fbc834e1, role_id=385cdabadee14249a091591e0a2961f2)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:58.316425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cedcde-c77a-4e0d-a1a1-a873e4cbdaf1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:58.346215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 145/291] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:39:58.356380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba6410-aa57-4d0e-9d39-55d7c92608db None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:58.390451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:58.401545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 147/292] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:39:58 2022] PUT /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640/users/4f2e24532712433f85f869d0fbc834e1/roles/385cdabadee14249a091591e0a2961f2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:39:58.527507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba6410-aa57-4d0e-9d39-55d7c92608db None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:58.590532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5280fef-0f90-495a-9af5-64bd8546f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:58.591260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280fef-0f90-495a-9af5-64bd8546f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:58.591539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280fef-0f90-495a-9af5-64bd8546f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:58.591810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280fef-0f90-495a-9af5-64bd8546f9d4 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:58.592949 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5280fef-0f90-495a-9af5-64bd8546f9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:58.594474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5280fef-0f90-495a-9af5-64bd8546f9d4 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:58.596551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 146/293] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:39:58 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:58.603806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cedcde-c77a-4e0d-a1a1-a873e4cbdaf1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:58.734527 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cedcde-c77a-4e0d-a1a1-a873e4cbdaf1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:58.773700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728af9c-8d04-452a-9676-28371b19dcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:58.774315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728af9c-8d04-452a-9676-28371b19dcbc None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:58.774589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728af9c-8d04-452a-9676-28371b19dcbc None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:58.774863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728af9c-8d04-452a-9676-28371b19dcbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:58.775632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728af9c-8d04-452a-9676-28371b19dcbc None admin] RBAC: Adding query filter params (role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=6e41da4162ce4e9e826e0da589f2c640, user.id=9c0d328de5e94beaa1aed5e0fd402095) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:39:58.775937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728af9c-8d04-452a-9676-28371b19dcbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:58.777397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728af9c-8d04-452a-9676-28371b19dcbc None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:58.784065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 148/294] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:39:58 2022] GET /identity/v3/role_assignments?user.id=9c0d328de5e94beaa1aed5e0fd402095&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:39:59.446476 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09268-7345-4614-9a99-1743afd3378e None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:59.446980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09268-7345-4614-9a99-1743afd3378e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:59.447065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09268-7345-4614-9a99-1743afd3378e None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:59.448666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 147/295] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:59.454113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203361ba-eee3-440a-9fa3-ea323b9df2c6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:59.454553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203361ba-eee3-440a-9fa3-ea323b9df2c6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:59.454736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203361ba-eee3-440a-9fa3-ea323b9df2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:59.459211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95e45-97ef-4c8b-8dcd-e0ed7b6b20ea None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:59.459527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95e45-97ef-4c8b-8dcd-e0ed7b6b20ea None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:59.459812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95e45-97ef-4c8b-8dcd-e0ed7b6b20ea None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:59.461116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 148/296] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:39:59.466546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a63e61-2a08-42e1-a918-013aabc602ef None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:59.466827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a63e61-2a08-42e1-a918-013aabc602ef None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:59.466941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:59.467097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a63e61-2a08-42e1-a918-013aabc602ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:59.484171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-203361ba-eee3-440a-9fa3-ea323b9df2c6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:59.485433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-203361ba-eee3-440a-9fa3-ea323b9df2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:59.492094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d1a63e61-2a08-42e1-a918-013aabc602ef None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:39:59.493289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d1a63e61-2a08-42e1-a918-013aabc602ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:39:59.560670 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 149/297] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:39:59.587031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 149/298] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:39:59.836400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203361ba-eee3-440a-9fa3-ea323b9df2c6 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:59.857991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a63e61-2a08-42e1-a918-013aabc602ef None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:39:59.884841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:39:59.952853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203361ba-eee3-440a-9fa3-ea323b9df2c6 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:59.981280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a63e61-2a08-42e1-a918-013aabc602ef None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:39:59.991026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a2be5-2e41-41f3-9d1e-000299c5fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:39:59.991705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a2be5-2e41-41f3-9d1e-000299c5fd00 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:39:59.991983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a2be5-2e41-41f3-9d1e-000299c5fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:39:59.992253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a2be5-2e41-41f3-9d1e-000299c5fd00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:39:59.993504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a2be5-2e41-41f3-9d1e-000299c5fd00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:39:59.995507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a2be5-2e41-41f3-9d1e-000299c5fd00 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:39:59.997091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 150/299] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:39:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:00.002717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ed91-6733-4757-b7ca-83a811e1dca0 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.003004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ed91-6733-4757-b7ca-83a811e1dca0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.003310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52ed91-6733-4757-b7ca-83a811e1dca0 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.009019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 151/300] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:00.009019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52ed91-6733-4757-b7ca-83a811e1dca0 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:00.009869 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:00.021770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e93d0e-f0bb-49c5-92a0-d5af3d6d3863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:00.022404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e93d0e-f0bb-49c5-92a0-d5af3d6d3863 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.023616 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e93d0e-f0bb-49c5-92a0-d5af3d6d3863 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.023616 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e93d0e-f0bb-49c5-92a0-d5af3d6d3863 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.035057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e93d0e-f0bb-49c5-92a0-d5af3d6d3863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-66e93d0e-f0bb-49c5-92a0-d5af3d6d3863 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:00.040926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:00.042103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:00.042905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 150/301] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:39:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:00.044290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b13430-452b-4521-b6f5-b6c859be0924 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.044580 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b13430-452b-4521-b6f5-b6c859be0924 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.044853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b13430-452b-4521-b6f5-b6c859be0924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.064759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-08b13430-452b-4521-b6f5-b6c859be0924 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:00.065965 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-08b13430-452b-4521-b6f5-b6c859be0924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:00.126696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52ed91-6733-4757-b7ca-83a811e1dca0 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:00.143267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 151/302] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:00.143267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b13430-452b-4521-b6f5-b6c859be0924 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:00.161038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:00.171205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e20b-6ad8-4e4b-9646-ed1e8310fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:00.171943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e20b-6ad8-4e4b-9646-ed1e8310fe21 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.172291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e20b-6ad8-4e4b-9646-ed1e8310fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.172634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e20b-6ad8-4e4b-9646-ed1e8310fe21 None admin] PATH_INFO: `/v3/groups` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.173330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34e20b-6ad8-4e4b-9646-ed1e8310fe21 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:00.174852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34e20b-6ad8-4e4b-9646-ed1e8310fe21 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:00.256232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 152/303] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Aug 22 19:40:00 2022] POST /identity/v3/groups => generated 229 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:40:00.269496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b13430-452b-4521-b6f5-b6c859be0924 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:00.313299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f56d4a-cac9-4d9c-be54-fbde00251378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:00.314363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f56d4a-cac9-4d9c-be54-fbde00251378 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.314898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f56d4a-cac9-4d9c-be54-fbde00251378 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.315481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f56d4a-cac9-4d9c-be54-fbde00251378 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.316431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f56d4a-cac9-4d9c-be54-fbde00251378 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:00.317603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f56d4a-cac9-4d9c-be54-fbde00251378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:00.319329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f56d4a-cac9-4d9c-be54-fbde00251378 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:00.330450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 152/304] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:00.337956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e20b-6ad8-4e4b-9646-ed1e8310fe21 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:00.418463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:00.438121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f56d4a-cac9-4d9c-be54-fbde00251378 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:00.470190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e20b-6ad8-4e4b-9646-ed1e8310fe21 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:00.513849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52e7db-0aa0-44eb-959d-15d10c1109c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:00.514530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52e7db-0aa0-44eb-959d-15d10c1109c3 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.514807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52e7db-0aa0-44eb-959d-15d10c1109c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.515073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52e7db-0aa0-44eb-959d-15d10c1109c3 None admin] PATH_INFO: `/v3/users/1e993087aade48d2a3b82dfc5b92271e` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.529790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:00.530286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52e7db-0aa0-44eb-959d-15d10c1109c3 None admin] RBAC: Authorizing `identity:get_user(user_id=1e993087aade48d2a3b82dfc5b92271e)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:00.532252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52e7db-0aa0-44eb-959d-15d10c1109c3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:00.535284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 153/305] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:40:00 2022] GET /identity/v3/users/1e993087aade48d2a3b82dfc5b92271e => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:00.541381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52e7db-0aa0-44eb-959d-15d10c1109c3 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:00.577259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f56d4a-cac9-4d9c-be54-fbde00251378 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:00.624392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598348d3-53c9-472b-a3ef-4703e10bd322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:00.625448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598348d3-53c9-472b-a3ef-4703e10bd322 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.625804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598348d3-53c9-472b-a3ef-4703e10bd322 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.627023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598348d3-53c9-472b-a3ef-4703e10bd322 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.640834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598348d3-53c9-472b-a3ef-4703e10bd322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-598348d3-53c9-472b-a3ef-4703e10bd322 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:00.647712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:00.648744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:00.649703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:00.653346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 153/306] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:00.658301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598348d3-53c9-472b-a3ef-4703e10bd322 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:00.675338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52e7db-0aa0-44eb-959d-15d10c1109c3 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:00.706511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:00.724978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d46496-b7c5-4ceb-bba1-7351334b61fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:00.725736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46496-b7c5-4ceb-bba1-7351334b61fd None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.726107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46496-b7c5-4ceb-bba1-7351334b61fd None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.726488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d46496-b7c5-4ceb-bba1-7351334b61fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.727362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d46496-b7c5-4ceb-bba1-7351334b61fd None admin] RBAC: Adding query filter params (role.id=385cdabadee14249a091591e0a2961f2, user.id=1e993087aade48d2a3b82dfc5b92271e, scope.system=all) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:00.727822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d46496-b7c5-4ceb-bba1-7351334b61fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:00.729386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d46496-b7c5-4ceb-bba1-7351334b61fd None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:00.734857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 154/307] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Aug 22 19:40:00 2022] GET /identity/v3/role_assignments?user.id=1e993087aade48d2a3b82dfc5b92271e&scope.system=all&role.id=385cdabadee14249a091591e0a2961f2 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:00.743262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064da70f-87b8-448a-b31a-2336a53f89fa None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.743262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064da70f-87b8-448a-b31a-2336a53f89fa None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.743262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064da70f-87b8-448a-b31a-2336a53f89fa None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.743262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 155/308] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:00.745027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c9f22-294a-4046-955d-04141f45ec62 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.745430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c9f22-294a-4046-955d-04141f45ec62 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.745809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c9f22-294a-4046-955d-04141f45ec62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.768791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-014c9f22-294a-4046-955d-04141f45ec62 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:00.770372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-014c9f22-294a-4046-955d-04141f45ec62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:00.788999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598348d3-53c9-472b-a3ef-4703e10bd322 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:00.828484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:00.835209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eee27f-3e4c-4927-87dd-33895fbe61a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:00.835882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eee27f-3e4c-4927-87dd-33895fbe61a2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:00.836272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eee27f-3e4c-4927-87dd-33895fbe61a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:00.836587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eee27f-3e4c-4927-87dd-33895fbe61a2 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:00.837327 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eee27f-3e4c-4927-87dd-33895fbe61a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:00.837630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eee27f-3e4c-4927-87dd-33895fbe61a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:00.839335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eee27f-3e4c-4927-87dd-33895fbe61a2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:00.849400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 154/309] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:00.855113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eee27f-3e4c-4927-87dd-33895fbe61a2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:00.867741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 156/310] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:00.972466 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eee27f-3e4c-4927-87dd-33895fbe61a2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:01.008346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee3f19-b4eb-41e2-82ae-13f20d8dbb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:01.009220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee3f19-b4eb-41e2-82ae-13f20d8dbb05 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:01.009637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee3f19-b4eb-41e2-82ae-13f20d8dbb05 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:01.010046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee3f19-b4eb-41e2-82ae-13f20d8dbb05 None admin] PATH_INFO: `/v3/users/4f7abb1c6bc54cd9bf45b0b4f83e0c42` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:01.011428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee3f19-b4eb-41e2-82ae-13f20d8dbb05 None admin] RBAC: Authorizing `identity:get_user(user_id=4f7abb1c6bc54cd9bf45b0b4f83e0c42)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:01.013017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee3f19-b4eb-41e2-82ae-13f20d8dbb05 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:01.015046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 155/311] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:40:00 2022] GET /identity/v3/users/4f7abb1c6bc54cd9bf45b0b4f83e0c42 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:01.021561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c9f22-294a-4046-955d-04141f45ec62 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:01.129760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c9f22-294a-4046-955d-04141f45ec62 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:01.144263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:01.151939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee3f19-b4eb-41e2-82ae-13f20d8dbb05 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:01.165043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68df860-63e8-40df-bfb6-c70104a67ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:01.165738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68df860-63e8-40df-bfb6-c70104a67ce7 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:01.166039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68df860-63e8-40df-bfb6-c70104a67ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:01.166345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68df860-63e8-40df-bfb6-c70104a67ce7 None admin] PATH_INFO: `/v3/system/users/4f7abb1c6bc54cd9bf45b0b4f83e0c42/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:01.168026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68df860-63e8-40df-bfb6-c70104a67ce7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4f7abb1c6bc54cd9bf45b0b4f83e0c42, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:01.169439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68df860-63e8-40df-bfb6-c70104a67ce7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:01.218437 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:01.257831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 157/312] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Aug 22 19:40:01 2022] PUT /identity/v3/system/users/4f7abb1c6bc54cd9bf45b0b4f83e0c42/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:01.268044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee3f19-b4eb-41e2-82ae-13f20d8dbb05 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:01.310161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11fe78-3908-4bff-84ec-420518249899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:01.310891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11fe78-3908-4bff-84ec-420518249899 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:01.312052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11fe78-3908-4bff-84ec-420518249899 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:01.312052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11fe78-3908-4bff-84ec-420518249899 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:01.324252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11fe78-3908-4bff-84ec-420518249899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-6d11fe78-3908-4bff-84ec-420518249899 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:01.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:01.330848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:01.331688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 156/313] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:01.337725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68df860-63e8-40df-bfb6-c70104a67ce7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:01.459916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68df860-63e8-40df-bfb6-c70104a67ce7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:01.496250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ea01-fd9f-46a2-950d-856dbb08e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:01.496860 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ea01-fd9f-46a2-950d-856dbb08e57e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:01.497120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ea01-fd9f-46a2-950d-856dbb08e57e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:01.497393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ea01-fd9f-46a2-950d-856dbb08e57e None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:01.498063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ea01-fd9f-46a2-950d-856dbb08e57e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:01.498359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ea01-fd9f-46a2-950d-856dbb08e57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:01.499792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ea01-fd9f-46a2-950d-856dbb08e57e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:01.510115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 158/314] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:01.515761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11fe78-3908-4bff-84ec-420518249899 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:01.618734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11fe78-3908-4bff-84ec-420518249899 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:01.639588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:01.654306 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a734de-0f59-4a19-aa09-5301cd11ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:01.654942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a734de-0f59-4a19-aa09-5301cd11ec25 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:01.655233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a734de-0f59-4a19-aa09-5301cd11ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:01.658623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a734de-0f59-4a19-aa09-5301cd11ec25 None admin] PATH_INFO: `/v3/users/4f2e24532712433f85f869d0fbc834e1` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:01.658623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a734de-0f59-4a19-aa09-5301cd11ec25 None admin] RBAC: Authorizing `identity:get_user(user_id=4f2e24532712433f85f869d0fbc834e1)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:01.658623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a734de-0f59-4a19-aa09-5301cd11ec25 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:01.660067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 157/315] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:40:01 2022] GET /identity/v3/users/4f2e24532712433f85f869d0fbc834e1 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:01.665835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ea01-fd9f-46a2-950d-856dbb08e57e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:01.711506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:01.773134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ea01-fd9f-46a2-950d-856dbb08e57e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:01.811177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f672d1-6f4a-4f7c-9496-f536d84dfbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:01.811809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f672d1-6f4a-4f7c-9496-f536d84dfbd0 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:01.812080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f672d1-6f4a-4f7c-9496-f536d84dfbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:01.812348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f672d1-6f4a-4f7c-9496-f536d84dfbd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:01.888710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f672d1-6f4a-4f7c-9496-f536d84dfbd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:01.890209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f672d1-6f4a-4f7c-9496-f536d84dfbd0 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:01.937293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:02.002801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 159/316] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:02.009566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a734de-0f59-4a19-aa09-5301cd11ec25 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:02.111234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a734de-0f59-4a19-aa09-5301cd11ec25 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:02.145881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92e3c3-08ca-4d26-adcd-adda780f98a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:02.146520 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92e3c3-08ca-4d26-adcd-adda780f98a3 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:02.146798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92e3c3-08ca-4d26-adcd-adda780f98a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:02.147071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92e3c3-08ca-4d26-adcd-adda780f98a3 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:02.148241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92e3c3-08ca-4d26-adcd-adda780f98a3 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:02.149701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92e3c3-08ca-4d26-adcd-adda780f98a3 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:02.151804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 158/317] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:02 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:02.157710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f672d1-6f4a-4f7c-9496-f536d84dfbd0 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:02.266232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f672d1-6f4a-4f7c-9496-f536d84dfbd0 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:02.304930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48891f6-92a9-43a5-b03d-b0aba74f792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:02.305542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48891f6-92a9-43a5-b03d-b0aba74f792d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:02.305819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48891f6-92a9-43a5-b03d-b0aba74f792d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:02.306089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48891f6-92a9-43a5-b03d-b0aba74f792d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:02.306820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48891f6-92a9-43a5-b03d-b0aba74f792d None admin] RBAC: Adding query filter params (role.id=385cdabadee14249a091591e0a2961f2, scope.project.id=6e41da4162ce4e9e826e0da589f2c640, user.id=4f2e24532712433f85f869d0fbc834e1) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:02.307124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48891f6-92a9-43a5-b03d-b0aba74f792d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:02.308595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48891f6-92a9-43a5-b03d-b0aba74f792d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:02.315053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 160/318] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:02 2022] GET /identity/v3/role_assignments?user.id=4f2e24532712433f85f869d0fbc834e1&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=385cdabadee14249a091591e0a2961f2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:02.374432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d6f90-f57d-46b1-bc7f-28ed1491576a None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:02.374622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d6f90-f57d-46b1-bc7f-28ed1491576a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:02.374847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d6f90-f57d-46b1-bc7f-28ed1491576a None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:02.376694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 159/319] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:02.383324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d1859-8e46-44ad-985b-a22f3e61dbfb None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:02.384418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d1859-8e46-44ad-985b-a22f3e61dbfb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:02.384418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d1859-8e46-44ad-985b-a22f3e61dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:02.402266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:02.416341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-527d1859-8e46-44ad-985b-a22f3e61dbfb None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:02.417949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-527d1859-8e46-44ad-985b-a22f3e61dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:02.497600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 161/320] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:02.786660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d6f90-f57d-46b1-bc7f-28ed1491576a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:02.827795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30724d4f-a2db-440c-9581-fdc8d6a82910 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:02.828415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30724d4f-a2db-440c-9581-fdc8d6a82910 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:02.828884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30724d4f-a2db-440c-9581-fdc8d6a82910 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:02.830428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 162/321] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:02.843863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4b4c4-6011-4115-b29a-0c5cadef19ab None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:02.844181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4b4c4-6011-4115-b29a-0c5cadef19ab None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:02.845947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4b4c4-6011-4115-b29a-0c5cadef19ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:02.851202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:02.863615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-acb4b4c4-6011-4115-b29a-0c5cadef19ab None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:02.865472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-acb4b4c4-6011-4115-b29a-0c5cadef19ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:02.899995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d6f90-f57d-46b1-bc7f-28ed1491576a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:02.941746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e5508-6378-4462-8989-72e174ae9c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:02.942135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 163/322] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:02.942285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e5508-6378-4462-8989-72e174ae9c86 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:02.942493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e5508-6378-4462-8989-72e174ae9c86 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:02.942737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e5508-6378-4462-8989-72e174ae9c86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:02.943767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e5508-6378-4462-8989-72e174ae9c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:02.945362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e5508-6378-4462-8989-72e174ae9c86 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:02.947054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 160/323] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:02.953230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4b4c4-6011-4115-b29a-0c5cadef19ab None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:03.019212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:03.058748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4b4c4-6011-4115-b29a-0c5cadef19ab None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:03.094336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff7d7-d74f-420f-90db-81daed7773f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:03.094946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff7d7-d74f-420f-90db-81daed7773f6 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:03.095212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff7d7-d74f-420f-90db-81daed7773f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:03.095507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff7d7-d74f-420f-90db-81daed7773f6 None admin] PATH_INFO: `/v3/groups` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:03.096134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff7d7-d74f-420f-90db-81daed7773f6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:03.097562 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff7d7-d74f-420f-90db-81daed7773f6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:03.181635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 164/324] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Aug 22 19:40:02 2022] POST /identity/v3/groups => generated 226 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:40:03.211241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e5508-6378-4462-8989-72e174ae9c86 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:03.324119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e5508-6378-4462-8989-72e174ae9c86 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:03.353246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:03.364077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c0074-5e49-490c-8ed2-f977125b7ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:03.368706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c0074-5e49-490c-8ed2-f977125b7ddf None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:03.368706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c0074-5e49-490c-8ed2-f977125b7ddf None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:03.368706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c0074-5e49-490c-8ed2-f977125b7ddf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:03.376540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c0074-5e49-490c-8ed2-f977125b7ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-a77c0074-5e49-490c-8ed2-f977125b7ddf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:03.381880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:03.382764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:03.383675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 161/325] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:03.388628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c0074-5e49-490c-8ed2-f977125b7ddf None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:03.388790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0680d-311c-43b1-9dc3-96b950626818 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:03.389064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0680d-311c-43b1-9dc3-96b950626818 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:03.389340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0680d-311c-43b1-9dc3-96b950626818 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:03.393772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 165/326] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:03.398257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f3ba9-755f-45f2-9cad-c4d9d9a2260f None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:03.398556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f3ba9-755f-45f2-9cad-c4d9d9a2260f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:03.398840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f3ba9-755f-45f2-9cad-c4d9d9a2260f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:03.426504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b78f3ba9-755f-45f2-9cad-c4d9d9a2260f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:03.428502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b78f3ba9-755f-45f2-9cad-c4d9d9a2260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:03.513051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 166/327] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:03.518767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c0074-5e49-490c-8ed2-f977125b7ddf None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:03.558261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b26fca-c062-4d74-b9e7-16726e64e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:03.558881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b26fca-c062-4d74-b9e7-16726e64e719 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:03.559159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b26fca-c062-4d74-b9e7-16726e64e719 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:03.559467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b26fca-c062-4d74-b9e7-16726e64e719 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:03.560146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b26fca-c062-4d74-b9e7-16726e64e719 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:03.560452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b26fca-c062-4d74-b9e7-16726e64e719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:03.561878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b26fca-c062-4d74-b9e7-16726e64e719 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:03.571799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 162/328] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:03.577263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f3ba9-755f-45f2-9cad-c4d9d9a2260f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:03.641340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:03.690486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f3ba9-755f-45f2-9cad-c4d9d9a2260f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:03.728258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0c4dd-f54b-40bc-9a1d-ab3cbebd8511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:03.728948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0c4dd-f54b-40bc-9a1d-ab3cbebd8511 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:03.729235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0c4dd-f54b-40bc-9a1d-ab3cbebd8511 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:03.729585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0c4dd-f54b-40bc-9a1d-ab3cbebd8511 None admin] PATH_INFO: `/v3/users/1e993087aade48d2a3b82dfc5b92271e` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:03.730722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0c4dd-f54b-40bc-9a1d-ab3cbebd8511 None admin] RBAC: Authorizing `identity:get_user(user_id=1e993087aade48d2a3b82dfc5b92271e)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:03.732256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0c4dd-f54b-40bc-9a1d-ab3cbebd8511 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:03.736271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 167/329] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:40:03 2022] GET /identity/v3/users/1e993087aade48d2a3b82dfc5b92271e => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:03.741593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b26fca-c062-4d74-b9e7-16726e64e719 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:03.794031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:03.813182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0c4dd-f54b-40bc-9a1d-ab3cbebd8511 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:03.866631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b26fca-c062-4d74-b9e7-16726e64e719 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:03.910996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72c796-1d47-4aa3-9bab-d9a4eb120dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:03.911769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72c796-1d47-4aa3-9bab-d9a4eb120dab None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:03.912052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72c796-1d47-4aa3-9bab-d9a4eb120dab None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:03.912326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72c796-1d47-4aa3-9bab-d9a4eb120dab None admin] PATH_INFO: `/v3/system/users/1e993087aade48d2a3b82dfc5b92271e/roles/385cdabadee14249a091591e0a2961f2` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:03.913784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72c796-1d47-4aa3-9bab-d9a4eb120dab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1e993087aade48d2a3b82dfc5b92271e, role_id=385cdabadee14249a091591e0a2961f2)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:03.915196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72c796-1d47-4aa3-9bab-d9a4eb120dab None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:03.954123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0c4dd-f54b-40bc-9a1d-ab3cbebd8511 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:03.980861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:03.987149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 163/330] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Aug 22 19:40:03 2022] PUT /identity/v3/system/users/1e993087aade48d2a3b82dfc5b92271e/roles/385cdabadee14249a091591e0a2961f2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:40:03.995584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6da2-febc-4ddd-8642-bee961944fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:03.996355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6da2-febc-4ddd-8642-bee961944fe5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:03.996635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6da2-febc-4ddd-8642-bee961944fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:03.996905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6da2-febc-4ddd-8642-bee961944fe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:04.010788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e6da2-febc-4ddd-8642-bee961944fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-804e6da2-febc-4ddd-8642-bee961944fe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:04.017235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:04.018185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:04.018974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:04.020808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 168/331] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:04.025639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72c796-1d47-4aa3-9bab-d9a4eb120dab None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:04.163575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72c796-1d47-4aa3-9bab-d9a4eb120dab None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:04.175408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:04.202519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f0ec3-a261-4c77-9526-85e818ce9440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:04.203144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0ec3-a261-4c77-9526-85e818ce9440 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:04.203485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0ec3-a261-4c77-9526-85e818ce9440 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:04.203760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0ec3-a261-4c77-9526-85e818ce9440 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:04.204505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f0ec3-a261-4c77-9526-85e818ce9440 None admin] RBAC: Adding query filter params (name=member) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:04.204816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f0ec3-a261-4c77-9526-85e818ce9440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:04.206264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f0ec3-a261-4c77-9526-85e818ce9440 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:04.216428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 164/332] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:04.221973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6da2-febc-4ddd-8642-bee961944fe5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:04.330684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6da2-febc-4ddd-8642-bee961944fe5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:04.368978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a4ca4-5773-4066-baba-6ba5640734ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:04.369623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a4ca4-5773-4066-baba-6ba5640734ec None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:04.370035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a4ca4-5773-4066-baba-6ba5640734ec None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:04.370305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a4ca4-5773-4066-baba-6ba5640734ec None admin] PATH_INFO: `/v3/users/4f7abb1c6bc54cd9bf45b0b4f83e0c42` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:04.371469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a4ca4-5773-4066-baba-6ba5640734ec None admin] RBAC: Authorizing `identity:get_user(user_id=4f7abb1c6bc54cd9bf45b0b4f83e0c42)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:04.372913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a4ca4-5773-4066-baba-6ba5640734ec None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:04.374491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 169/333] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:40:04 2022] GET /identity/v3/users/4f7abb1c6bc54cd9bf45b0b4f83e0c42 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:04.380882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f0ec3-a261-4c77-9526-85e818ce9440 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:04.519857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f0ec3-a261-4c77-9526-85e818ce9440 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:04.562047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042b8ad-8a87-44ed-9100-75e050030c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:04.562658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042b8ad-8a87-44ed-9100-75e050030c0d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:04.562963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042b8ad-8a87-44ed-9100-75e050030c0d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:04.563185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042b8ad-8a87-44ed-9100-75e050030c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:04.563939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042b8ad-8a87-44ed-9100-75e050030c0d None admin] RBAC: Adding query filter params (role.id=62d0acf1402140c5a97def31e7b912c7, user.id=4f7abb1c6bc54cd9bf45b0b4f83e0c42, scope.system=all) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:04.564237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042b8ad-8a87-44ed-9100-75e050030c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:04.565657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042b8ad-8a87-44ed-9100-75e050030c0d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:04.578174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 165/334] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Aug 22 19:40:04 2022] GET /identity/v3/role_assignments?user.id=4f7abb1c6bc54cd9bf45b0b4f83e0c42&scope.system=all&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:05.856581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65a03-e2ac-4bdd-b545-5d97ba9860cc None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:05.857091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65a03-e2ac-4bdd-b545-5d97ba9860cc None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:05.857166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65a03-e2ac-4bdd-b545-5d97ba9860cc None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:05.858719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 170/335] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:05.876091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f973-b860-46d6-80ff-d681aca51a7d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:05.876584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f973-b860-46d6-80ff-d681aca51a7d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:05.876659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232f973-b860-46d6-80ff-d681aca51a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:05.902963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7232f973-b860-46d6-80ff-d681aca51a7d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:05.904220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7232f973-b860-46d6-80ff-d681aca51a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:05.935788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:05.986189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 166/336] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:06.484922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf615bf9-4674-44f1-9653-59556337e514 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:06.485550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf615bf9-4674-44f1-9653-59556337e514 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:06.486045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf615bf9-4674-44f1-9653-59556337e514 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:06.487981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 171/337] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:06.494103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cb509-7d83-4c55-bd56-c0d01c7dcacd None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:06.494646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cb509-7d83-4c55-bd56-c0d01c7dcacd None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:06.495124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cb509-7d83-4c55-bd56-c0d01c7dcacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:06.516150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-511cb509-7d83-4c55-bd56-c0d01c7dcacd None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:06.517697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-511cb509-7d83-4c55-bd56-c0d01c7dcacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:06.556728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf615bf9-4674-44f1-9653-59556337e514 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:06.612652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 167/338] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:06.614659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc8d9-bf9f-4c1d-ab28-a826d6d891e7 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:06.615183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc8d9-bf9f-4c1d-ab28-a826d6d891e7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:06.615708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecc8d9-bf9f-4c1d-ab28-a826d6d891e7 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:06.617466 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 168/339] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:06.622550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e61c9-2ff1-4943-b6f9-f04361198a08 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:06.623074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e61c9-2ff1-4943-b6f9-f04361198a08 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:06.623590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e61c9-2ff1-4943-b6f9-f04361198a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:06.636147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:06.647109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-a18e61c9-2ff1-4943-b6f9-f04361198a08 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:06.648750 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a18e61c9-2ff1-4943-b6f9-f04361198a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:06.724139 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf615bf9-4674-44f1-9653-59556337e514 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:06.732081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 169/340] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:06.733593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071c399-0a77-41f7-81cf-3ad6e2353843 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:06.734113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071c399-0a77-41f7-81cf-3ad6e2353843 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:06.734586 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071c399-0a77-41f7-81cf-3ad6e2353843 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:06.736067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 170/341] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:06.742398 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541d759-2f13-4b6a-ba0d-e9930071bd1d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:06.742963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541d759-2f13-4b6a-ba0d-e9930071bd1d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:06.743484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541d759-2f13-4b6a-ba0d-e9930071bd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:06.765254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7541d759-2f13-4b6a-ba0d-e9930071bd1d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:06.767375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7541d759-2f13-4b6a-ba0d-e9930071bd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:06.784480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:06.801533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1639a-922c-4d96-b24a-6dce89e5b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:06.802464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1639a-922c-4d96-b24a-6dce89e5b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:06.802893 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1639a-922c-4d96-b24a-6dce89e5b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:06.803335 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1639a-922c-4d96-b24a-6dce89e5b0a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:06.832187 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1639a-922c-4d96-b24a-6dce89e5b0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-d2d1639a-922c-4d96-b24a-6dce89e5b0a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:06.837841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:06.838851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:06.839697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:06.842062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 172/342] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:06.852347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1639a-922c-4d96-b24a-6dce89e5b0a1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:06.853630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 171/343] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:07.003493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1639a-922c-4d96-b24a-6dce89e5b0a1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:07.021447 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:07.046698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956f6d2-1c0b-4420-baba-6442270da680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:07.047690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956f6d2-1c0b-4420-baba-6442270da680 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:07.048174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956f6d2-1c0b-4420-baba-6442270da680 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:07.048648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956f6d2-1c0b-4420-baba-6442270da680 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:07.049527 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956f6d2-1c0b-4420-baba-6442270da680 None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:07.050054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956f6d2-1c0b-4420-baba-6442270da680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:07.051912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956f6d2-1c0b-4420-baba-6442270da680 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:07.067931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 173/344] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:07.073921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541d759-2f13-4b6a-ba0d-e9930071bd1d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:07.163048 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956f6d2-1c0b-4420-baba-6442270da680 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:07.219768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541d759-2f13-4b6a-ba0d-e9930071bd1d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:07.278227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fdafb-eedc-4171-a449-1e6f70c71852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:07.278771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdafb-eedc-4171-a449-1e6f70c71852 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:07.279047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdafb-eedc-4171-a449-1e6f70c71852 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:07.279342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fdafb-eedc-4171-a449-1e6f70c71852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:07.315609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:07.368669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fdafb-eedc-4171-a449-1e6f70c71852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:07.370167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fdafb-eedc-4171-a449-1e6f70c71852 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:07.374916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956f6d2-1c0b-4420-baba-6442270da680 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:07.431829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a470fa0-16cb-4068-84a6-c9a65fa7ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:07.432540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a470fa0-16cb-4068-84a6-c9a65fa7ba6d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:07.432818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a470fa0-16cb-4068-84a6-c9a65fa7ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:07.433094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a470fa0-16cb-4068-84a6-c9a65fa7ba6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:07.445677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a470fa0-16cb-4068-84a6-c9a65fa7ba6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-1a470fa0-16cb-4068-84a6-c9a65fa7ba6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:07.453867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:07.454749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 174/345] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:07.455659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a470fa0-16cb-4068-84a6-c9a65fa7ba6d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:07.499619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:07.510792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 172/346] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:07.512042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fdafb-eedc-4171-a449-1e6f70c71852 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:07.577615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:07.596660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a470fa0-16cb-4068-84a6-c9a65fa7ba6d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:07.649503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917266c2-6669-4e18-a83f-e0c3b4d6e678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:07.650119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fdafb-eedc-4171-a449-1e6f70c71852 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:07.650252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917266c2-6669-4e18-a83f-e0c3b4d6e678 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:07.650424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917266c2-6669-4e18-a83f-e0c3b4d6e678 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:07.650668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917266c2-6669-4e18-a83f-e0c3b4d6e678 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:07.665872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917266c2-6669-4e18-a83f-e0c3b4d6e678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-917266c2-6669-4e18-a83f-e0c3b4d6e678 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:07.671124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:07.672095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:07.672966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:07.673577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 175/347] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:40:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:07.674578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1866bd-0757-48f7-8ff0-6b319b529ed2 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:07.674690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1866bd-0757-48f7-8ff0-6b319b529ed2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:07.674931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1866bd-0757-48f7-8ff0-6b319b529ed2 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:07.681404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 176/348] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:07.682195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1866bd-0757-48f7-8ff0-6b319b529ed2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:07.693659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f3803-77a8-41fc-b9ab-cc4506ea61ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:07.694309 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f3803-77a8-41fc-b9ab-cc4506ea61ad None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:07.694588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f3803-77a8-41fc-b9ab-cc4506ea61ad None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:07.694852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f3803-77a8-41fc-b9ab-cc4506ea61ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:07.707400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f3803-77a8-41fc-b9ab-cc4506ea61ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-c12f3803-77a8-41fc-b9ab-cc4506ea61ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:07.713333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:07.714234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:07.715118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 173/349] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:07.716392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f3803-77a8-41fc-b9ab-cc4506ea61ad None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:07.822749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:07.834053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1866bd-0757-48f7-8ff0-6b319b529ed2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:07.869676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f3803-77a8-41fc-b9ab-cc4506ea61ad None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:07.883393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:07.886421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d23ed-73bc-4e9d-bec6-06d06636a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:07.887031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d23ed-73bc-4e9d-bec6-06d06636a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:07.887395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d23ed-73bc-4e9d-bec6-06d06636a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:07.887660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d23ed-73bc-4e9d-bec6-06d06636a5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:07.888337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d23ed-73bc-4e9d-bec6-06d06636a5d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:07.888637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d23ed-73bc-4e9d-bec6-06d06636a5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:07.890607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d23ed-73bc-4e9d-bec6-06d06636a5d8 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:07.901088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 177/350] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:07.902040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d23ed-73bc-4e9d-bec6-06d06636a5d8 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:07.911818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e72ca7-5301-432b-b169-de937648990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:07.912665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72ca7-5301-432b-b169-de937648990a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:07.913125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72ca7-5301-432b-b169-de937648990a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:07.913692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e72ca7-5301-432b-b169-de937648990a None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:07.916144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e72ca7-5301-432b-b169-de937648990a None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:07.916394 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e72ca7-5301-432b-b169-de937648990a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:07.923180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 174/351] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:07 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:07.925769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273dcaa-fe22-428b-baf4-b1d388f6899d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:07.926839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273dcaa-fe22-428b-baf4-b1d388f6899d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:07.927178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273dcaa-fe22-428b-baf4-b1d388f6899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:07.947373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-4273dcaa-fe22-428b-baf4-b1d388f6899d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:07.948637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4273dcaa-fe22-428b-baf4-b1d388f6899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:08.029801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 175/352] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:08.030527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273dcaa-fe22-428b-baf4-b1d388f6899d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:08.033362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d23ed-73bc-4e9d-bec6-06d06636a5d8 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:08.074978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f14f7-d423-4348-8159-ff795a744792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:08.075630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f14f7-d423-4348-8159-ff795a744792 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:08.075904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f14f7-d423-4348-8159-ff795a744792 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:08.076171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f14f7-d423-4348-8159-ff795a744792 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:08.077018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f14f7-d423-4348-8159-ff795a744792 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:08.077315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f14f7-d423-4348-8159-ff795a744792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:08.079579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f14f7-d423-4348-8159-ff795a744792 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:08.089445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 178/353] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:08.090061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f14f7-d423-4348-8159-ff795a744792 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:08.117129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:08.173373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273dcaa-fe22-428b-baf4-b1d388f6899d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:08.187809 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:08.223712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d754ba-3a80-4021-b925-7ba44792f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:08.226168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d754ba-3a80-4021-b925-7ba44792f639 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:08.226168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d754ba-3a80-4021-b925-7ba44792f639 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:08.226496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d754ba-3a80-4021-b925-7ba44792f639 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:08.227456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d754ba-3a80-4021-b925-7ba44792f639 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:08.227864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d754ba-3a80-4021-b925-7ba44792f639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:08.230147 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d754ba-3a80-4021-b925-7ba44792f639 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:08.232330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f14f7-d423-4348-8159-ff795a744792 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:08.240516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 176/354] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:08.241485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d754ba-3a80-4021-b925-7ba44792f639 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:08.293009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d994f9-d1b0-4f01-b563-0cd0cf24893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:08.294487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d994f9-d1b0-4f01-b563-0cd0cf24893e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:08.294778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d994f9-d1b0-4f01-b563-0cd0cf24893e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:08.295049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d994f9-d1b0-4f01-b563-0cd0cf24893e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:08.380632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d994f9-d1b0-4f01-b563-0cd0cf24893e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:08.381366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d994f9-d1b0-4f01-b563-0cd0cf24893e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:08.383175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d754ba-3a80-4021-b925-7ba44792f639 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:08.406267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:08.431474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0078d0-6555-44fd-bc4a-c6aa09a5a3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:08.432254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0078d0-6555-44fd-bc4a-c6aa09a5a3a8 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:08.433204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0078d0-6555-44fd-bc4a-c6aa09a5a3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:08.435662 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0078d0-6555-44fd-bc4a-c6aa09a5a3a8 None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:08.444501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0078d0-6555-44fd-bc4a-c6aa09a5a3a8 None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:08.446121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0078d0-6555-44fd-bc4a-c6aa09a5a3a8 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:08.447833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 177/355] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:08 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:08.448613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0078d0-6555-44fd-bc4a-c6aa09a5a3a8 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:08.490216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:08.503696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 179/356] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:08.504707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d994f9-d1b0-4f01-b563-0cd0cf24893e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:08.575177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0078d0-6555-44fd-bc4a-c6aa09a5a3a8 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:08.621631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911383c-88a0-4813-b9e2-4edac0da3b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:08.622710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911383c-88a0-4813-b9e2-4edac0da3b58 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:08.622710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911383c-88a0-4813-b9e2-4edac0da3b58 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:08.622936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911383c-88a0-4813-b9e2-4edac0da3b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:08.627982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d994f9-d1b0-4f01-b563-0cd0cf24893e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:08.647540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:08.670051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049d507-aa55-4316-a0a9-d8f47b5c1a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:08.670691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049d507-aa55-4316-a0a9-d8f47b5c1a38 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:08.670967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049d507-aa55-4316-a0a9-d8f47b5c1a38 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:08.671319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049d507-aa55-4316-a0a9-d8f47b5c1a38 None admin] PATH_INFO: `/v3/users/1e993087aade48d2a3b82dfc5b92271e` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:08.673754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049d507-aa55-4316-a0a9-d8f47b5c1a38 None admin] RBAC: Authorizing `identity:get_user(user_id=1e993087aade48d2a3b82dfc5b92271e)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:08.675255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049d507-aa55-4316-a0a9-d8f47b5c1a38 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:08.677817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 180/357] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:40:08 2022] GET /identity/v3/users/1e993087aade48d2a3b82dfc5b92271e => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:08.678968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c86484-1ecb-46d2-b2a7-d27f1bc90834 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:08.683643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c86484-1ecb-46d2-b2a7-d27f1bc90834 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:08.683643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c86484-1ecb-46d2-b2a7-d27f1bc90834 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:08.686631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 181/358] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:08.687812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c86484-1ecb-46d2-b2a7-d27f1bc90834 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:08.702760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911383c-88a0-4813-b9e2-4edac0da3b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:08.704284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911383c-88a0-4813-b9e2-4edac0da3b58 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:08.744632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:08.816943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c86484-1ecb-46d2-b2a7-d27f1bc90834 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:08.825851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 178/359] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:08.826744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911383c-88a0-4813-b9e2-4edac0da3b58 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:08.856861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cf810-a111-4c43-98ca-d74d50171155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:08.857489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf810-a111-4c43-98ca-d74d50171155 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:08.857761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf810-a111-4c43-98ca-d74d50171155 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:08.858025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf810-a111-4c43-98ca-d74d50171155 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:08.872251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cf810-a111-4c43-98ca-d74d50171155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-bf5cf810-a111-4c43-98ca-d74d50171155 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:08.877029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:08.877968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:08.878776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 182/360] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:40:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:08.879506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cf810-a111-4c43-98ca-d74d50171155 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:08.942144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911383c-88a0-4813-b9e2-4edac0da3b58 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:08.946140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:08.986127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc08b-a256-4403-b14d-c62a83e4eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:08.987289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc08b-a256-4403-b14d-c62a83e4eda7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:08.987812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc08b-a256-4403-b14d-c62a83e4eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:08.988259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc08b-a256-4403-b14d-c62a83e4eda7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:08.989781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc08b-a256-4403-b14d-c62a83e4eda7 None admin] RBAC: Adding query filter params (group.id=131f425c486d468d9d2c4dd288ca4020, role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=5b45f2debc7148b79ed609906b98b179) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:08.990389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc08b-a256-4403-b14d-c62a83e4eda7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:08.992072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc08b-a256-4403-b14d-c62a83e4eda7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:08.994082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:08.998650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 179/361] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:08 2022] GET /identity/v3/role_assignments?group.id=131f425c486d468d9d2c4dd288ca4020&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:08.999532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc08b-a256-4403-b14d-c62a83e4eda7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:09.015950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cf810-a111-4c43-98ca-d74d50171155 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:09.067743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056db2b-d354-4efb-802f-1943a1793edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:09.068531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056db2b-d354-4efb-802f-1943a1793edd None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.068808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056db2b-d354-4efb-802f-1943a1793edd None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.069075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056db2b-d354-4efb-802f-1943a1793edd None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.070329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056db2b-d354-4efb-802f-1943a1793edd None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:09.072927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056db2b-d354-4efb-802f-1943a1793edd None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:09.078544 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 183/362] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:08 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:09.080009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187cc7-7d12-42da-8522-1ee93598fc05 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.080390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187cc7-7d12-42da-8522-1ee93598fc05 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.081404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187cc7-7d12-42da-8522-1ee93598fc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.102179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ed187cc7-7d12-42da-8522-1ee93598fc05 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:09.103574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ed187cc7-7d12-42da-8522-1ee93598fc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:09.153515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc08b-a256-4403-b14d-c62a83e4eda7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:09.188206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 184/363] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:09.189061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187cc7-7d12-42da-8522-1ee93598fc05 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:09.199402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff788e7b-5acc-48cd-be50-ea262d762edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:09.199954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff788e7b-5acc-48cd-be50-ea262d762edf None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.200295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff788e7b-5acc-48cd-be50-ea262d762edf None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.200569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff788e7b-5acc-48cd-be50-ea262d762edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.201302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff788e7b-5acc-48cd-be50-ea262d762edf None admin] RBAC: Adding query filter params (role.id=385cdabadee14249a091591e0a2961f2, user.id=1e993087aade48d2a3b82dfc5b92271e, scope.system=all) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:09.201606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff788e7b-5acc-48cd-be50-ea262d762edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:09.203101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff788e7b-5acc-48cd-be50-ea262d762edf None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:09.219215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 180/364] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Aug 22 19:40:08 2022] GET /identity/v3/role_assignments?user.id=1e993087aade48d2a3b82dfc5b92271e&scope.system=all&role.id=385cdabadee14249a091591e0a2961f2 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:09.220105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff788e7b-5acc-48cd-be50-ea262d762edf None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:09.250719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:09.312772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:09.330235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187cc7-7d12-42da-8522-1ee93598fc05 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:09.354904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff788e7b-5acc-48cd-be50-ea262d762edf None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:09.373536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d27e7-9ba3-43a1-a86f-f2554db4bb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:09.374245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d27e7-9ba3-43a1-a86f-f2554db4bb63 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.374478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d27e7-9ba3-43a1-a86f-f2554db4bb63 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.374755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d27e7-9ba3-43a1-a86f-f2554db4bb63 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.376376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d27e7-9ba3-43a1-a86f-f2554db4bb63 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:09.377849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d27e7-9ba3-43a1-a86f-f2554db4bb63 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:09.381785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 185/365] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:09 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:09.382709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d27e7-9ba3-43a1-a86f-f2554db4bb63 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:09.399003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3825b43-4138-4c99-8178-c3ebe1f4f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:09.399732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3825b43-4138-4c99-8178-c3ebe1f4f932 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.400021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3825b43-4138-4c99-8178-c3ebe1f4f932 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.400287 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3825b43-4138-4c99-8178-c3ebe1f4f932 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.400971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3825b43-4138-4c99-8178-c3ebe1f4f932 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:09.401272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3825b43-4138-4c99-8178-c3ebe1f4f932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:09.402733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3825b43-4138-4c99-8178-c3ebe1f4f932 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:09.413211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 181/366] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:09.418736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3825b43-4138-4c99-8178-c3ebe1f4f932 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:09.500331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d27e7-9ba3-43a1-a86f-f2554db4bb63 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:09.519749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:09.543807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740741a-9d63-4bee-81dc-517351e448a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:09.544451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740741a-9d63-4bee-81dc-517351e448a1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.544728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740741a-9d63-4bee-81dc-517351e448a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.544995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740741a-9d63-4bee-81dc-517351e448a1 None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.546147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740741a-9d63-4bee-81dc-517351e448a1 None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:09.547641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740741a-9d63-4bee-81dc-517351e448a1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:09.548598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3825b43-4138-4c99-8178-c3ebe1f4f932 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:09.549237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 186/367] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:09 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:09.550007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740741a-9d63-4bee-81dc-517351e448a1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:09.587475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:09.623907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc791d0-17c6-462a-9153-43a5fdfbb5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:09.624555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc791d0-17c6-462a-9153-43a5fdfbb5c6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.624835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc791d0-17c6-462a-9153-43a5fdfbb5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.625110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc791d0-17c6-462a-9153-43a5fdfbb5c6 None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.626895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc791d0-17c6-462a-9153-43a5fdfbb5c6 None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:09.628383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc791d0-17c6-462a-9153-43a5fdfbb5c6 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:09.630848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 182/368] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:09 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:09.631908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc791d0-17c6-462a-9153-43a5fdfbb5c6 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:09.707803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740741a-9d63-4bee-81dc-517351e448a1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:09.751425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01faa0f-8e40-4baa-92f8-97c8fe92dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:09.752392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01faa0f-8e40-4baa-92f8-97c8fe92dabf None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.752668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01faa0f-8e40-4baa-92f8-97c8fe92dabf None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.752935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01faa0f-8e40-4baa-92f8-97c8fe92dabf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.777014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc791d0-17c6-462a-9153-43a5fdfbb5c6 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:09.814707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:09.828793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118ea54-0c64-44dc-bdb3-62664e82f202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:09.829531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118ea54-0c64-44dc-bdb3-62664e82f202 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.829810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118ea54-0c64-44dc-bdb3-62664e82f202 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.830147 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118ea54-0c64-44dc-bdb3-62664e82f202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.830995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118ea54-0c64-44dc-bdb3-62664e82f202 None admin] RBAC: Adding query filter params (group.id=131f425c486d468d9d2c4dd288ca4020, role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=6e41da4162ce4e9e826e0da589f2c640) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:09.831425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118ea54-0c64-44dc-bdb3-62664e82f202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:09.832845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118ea54-0c64-44dc-bdb3-62664e82f202 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:09.839313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 183/369] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:09 2022] GET /identity/v3/role_assignments?group.id=131f425c486d468d9d2c4dd288ca4020&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:09.839608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118ea54-0c64-44dc-bdb3-62664e82f202 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:09.842597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01faa0f-8e40-4baa-92f8-97c8fe92dabf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:09.844228 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01faa0f-8e40-4baa-92f8-97c8fe92dabf None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:09.897403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:09.954934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118ea54-0c64-44dc-bdb3-62664e82f202 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:09.974478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 187/370] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:09.975896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01faa0f-8e40-4baa-92f8-97c8fe92dabf None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:09.994899 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c5715-9fd5-42b6-9474-6432747796db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:09.995565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c5715-9fd5-42b6-9474-6432747796db None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:09.995845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c5715-9fd5-42b6-9474-6432747796db None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:09.996119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c5715-9fd5-42b6-9474-6432747796db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:09.997051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c5715-9fd5-42b6-9474-6432747796db None admin] RBAC: Adding query filter params (group.id=131f425c486d468d9d2c4dd288ca4020, role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=5b45f2debc7148b79ed609906b98b179) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:09.997361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c5715-9fd5-42b6-9474-6432747796db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:09.999253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c5715-9fd5-42b6-9474-6432747796db None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:10.012723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 184/371] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:09 2022] GET /identity/v3/role_assignments?group.id=131f425c486d468d9d2c4dd288ca4020&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=25294da9af854bf181e95bc99a9818c8 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:10.012723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c5715-9fd5-42b6-9474-6432747796db None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:10.099978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:10.130691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01faa0f-8e40-4baa-92f8-97c8fe92dabf None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:10.185594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c5715-9fd5-42b6-9474-6432747796db None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:10.192309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75c312-a12a-4128-8796-49d8dcf19555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:10.193261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c312-a12a-4128-8796-49d8dcf19555 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:10.193732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c312-a12a-4128-8796-49d8dcf19555 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:10.194183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c312-a12a-4128-8796-49d8dcf19555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:10.209539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75c312-a12a-4128-8796-49d8dcf19555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-4a75c312-a12a-4128-8796-49d8dcf19555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:10.214790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:10.215720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:10.216602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:10.219183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 188/372] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:10.225659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75c312-a12a-4128-8796-49d8dcf19555 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:10.235590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:10.241134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059abf-d098-4396-b152-7a12c8314594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:10.242069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059abf-d098-4396-b152-7a12c8314594 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:10.242403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059abf-d098-4396-b152-7a12c8314594 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:10.242778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059abf-d098-4396-b152-7a12c8314594 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:10.244136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059abf-d098-4396-b152-7a12c8314594 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:10.245871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059abf-d098-4396-b152-7a12c8314594 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:10.248635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 185/373] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:10 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:10.264556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059abf-d098-4396-b152-7a12c8314594 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:10.350471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75c312-a12a-4128-8796-49d8dcf19555 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:10.391170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9f513-3546-40b3-ac3a-fef63fcfb7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:10.392244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9f513-3546-40b3-ac3a-fef63fcfb7bb None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:10.392655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9f513-3546-40b3-ac3a-fef63fcfb7bb None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:10.393052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9f513-3546-40b3-ac3a-fef63fcfb7bb None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:10.393873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9f513-3546-40b3-ac3a-fef63fcfb7bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:10.394305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9f513-3546-40b3-ac3a-fef63fcfb7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:10.396396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9f513-3546-40b3-ac3a-fef63fcfb7bb None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:10.403765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:10.406866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 189/374] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:10.414563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9f513-3546-40b3-ac3a-fef63fcfb7bb None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:10.460860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059abf-d098-4396-b152-7a12c8314594 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:10.526595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9f513-3546-40b3-ac3a-fef63fcfb7bb None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:10.537959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339de8d-2e5a-4b19-b889-1020ad43c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:10.538608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339de8d-2e5a-4b19-b889-1020ad43c12e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:10.538888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339de8d-2e5a-4b19-b889-1020ad43c12e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:10.539161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339de8d-2e5a-4b19-b889-1020ad43c12e None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:10.544019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339de8d-2e5a-4b19-b889-1020ad43c12e None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:10.545558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339de8d-2e5a-4b19-b889-1020ad43c12e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:10.547787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 186/375] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:10 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:10.556457 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339de8d-2e5a-4b19-b889-1020ad43c12e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:10.579144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9478fa1-b6e6-49ef-888a-52dac56540a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:10.580183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478fa1-b6e6-49ef-888a-52dac56540a7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:10.580712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478fa1-b6e6-49ef-888a-52dac56540a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:10.581173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9478fa1-b6e6-49ef-888a-52dac56540a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:10.656367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:10.701151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:10.705019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9478fa1-b6e6-49ef-888a-52dac56540a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:10.706515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9478fa1-b6e6-49ef-888a-52dac56540a7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:10.753114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339de8d-2e5a-4b19-b889-1020ad43c12e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:10.820926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 190/376] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:10.827190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc450ed-73d2-4915-9d2c-10c76feb64b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:10.828122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc450ed-73d2-4915-9d2c-10c76feb64b5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:10.828637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc450ed-73d2-4915-9d2c-10c76feb64b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:10.829102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc450ed-73d2-4915-9d2c-10c76feb64b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:10.830024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc450ed-73d2-4915-9d2c-10c76feb64b5 None admin] RBAC: Adding query filter params (group.id=131f425c486d468d9d2c4dd288ca4020, role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=6e41da4162ce4e9e826e0da589f2c640) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:10.830522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc450ed-73d2-4915-9d2c-10c76feb64b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:10.832733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc450ed-73d2-4915-9d2c-10c76feb64b5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:10.840164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9478fa1-b6e6-49ef-888a-52dac56540a7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:10.843335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 187/377] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:10 2022] GET /identity/v3/role_assignments?group.id=131f425c486d468d9d2c4dd288ca4020&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=25294da9af854bf181e95bc99a9818c8 => generated 260 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:10.946102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:10.949865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9478fa1-b6e6-49ef-888a-52dac56540a7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:10.996803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728226-5ac9-4625-b0b4-35f2cf76ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:10.997446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728226-5ac9-4625-b0b4-35f2cf76ac41 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:10.997725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728226-5ac9-4625-b0b4-35f2cf76ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:10.997997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d728226-5ac9-4625-b0b4-35f2cf76ac41 None admin] PATH_INFO: `/v3/projects/51271e31587049bcaa892f314e138418` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:10.999131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728226-5ac9-4625-b0b4-35f2cf76ac41 None admin] RBAC: Authorizing `identity:get_project(project_id=51271e31587049bcaa892f314e138418)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:11.000687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d728226-5ac9-4625-b0b4-35f2cf76ac41 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:11.002326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 191/378] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:10 2022] GET /identity/v3/projects/51271e31587049bcaa892f314e138418 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:11.009206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc450ed-73d2-4915-9d2c-10c76feb64b5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:11.166198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc450ed-73d2-4915-9d2c-10c76feb64b5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:11.186406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:11.213984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa9245-312a-4db3-af22-eb3e7eb11fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:11.214655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa9245-312a-4db3-af22-eb3e7eb11fca None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:11.214934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa9245-312a-4db3-af22-eb3e7eb11fca None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:11.215209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa9245-312a-4db3-af22-eb3e7eb11fca None admin] PATH_INFO: `/v3/groups/8a08ede2bf12452e897d9dcac17669bc` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:11.224190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa9245-312a-4db3-af22-eb3e7eb11fca None admin] RBAC: Authorizing `identity:get_group(group_id=8a08ede2bf12452e897d9dcac17669bc)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:11.225706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa9245-312a-4db3-af22-eb3e7eb11fca None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:11.227867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 188/379] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:11 2022] GET /identity/v3/groups/8a08ede2bf12452e897d9dcac17669bc => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:11.233846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728226-5ac9-4625-b0b4-35f2cf76ac41 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:11.376892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d728226-5ac9-4625-b0b4-35f2cf76ac41 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:11.418815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dab4fd-1750-4a5b-9678-fc51834f1233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:11.419389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab4fd-1750-4a5b-9678-fc51834f1233 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:11.419670 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab4fd-1750-4a5b-9678-fc51834f1233 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:11.419942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab4fd-1750-4a5b-9678-fc51834f1233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:11.420687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dab4fd-1750-4a5b-9678-fc51834f1233 None admin] RBAC: Adding query filter params (group.id=8a08ede2bf12452e897d9dcac17669bc, role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=51271e31587049bcaa892f314e138418) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:11.420993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dab4fd-1750-4a5b-9678-fc51834f1233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:11.422436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dab4fd-1750-4a5b-9678-fc51834f1233 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:11.429515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 192/380] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:11 2022] GET /identity/v3/role_assignments?group.id=8a08ede2bf12452e897d9dcac17669bc&scope.project.id=51271e31587049bcaa892f314e138418&role.id=9ec7f759c0a64655b794dfb597930076 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:11.602668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1260-62c4-4a96-8bd8-4d7132420582 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:11.603175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1260-62c4-4a96-8bd8-4d7132420582 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:11.603281 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1260-62c4-4a96-8bd8-4d7132420582 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:11.604844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 189/381] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:11.610594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bdea6-09fb-481b-bef9-70849ae4e2c1 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:11.610877 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bdea6-09fb-481b-bef9-70849ae4e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:11.611209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bdea6-09fb-481b-bef9-70849ae4e2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:11.641042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-971bdea6-09fb-481b-bef9-70849ae4e2c1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:11.642252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-971bdea6-09fb-481b-bef9-70849ae4e2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:11.673283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:11.717702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 193/382] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:12.108947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1260-62c4-4a96-8bd8-4d7132420582 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:12.174363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e31e49-7c96-417c-9a8d-1c9406b1016d None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:12.174640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e31e49-7c96-417c-9a8d-1c9406b1016d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:12.174913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e31e49-7c96-417c-9a8d-1c9406b1016d None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:12.177530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 194/383] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:12.182832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee026c-869b-4f70-834f-09b86bfc2a42 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:12.183288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee026c-869b-4f70-834f-09b86bfc2a42 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:12.183568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee026c-869b-4f70-834f-09b86bfc2a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:12.205401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0eee026c-869b-4f70-834f-09b86bfc2a42 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:12.207929 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0eee026c-869b-4f70-834f-09b86bfc2a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:12.256385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1260-62c4-4a96-8bd8-4d7132420582 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:12.295657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd37ef-a263-4a33-ba76-a6dbef318235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:12.296296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd37ef-a263-4a33-ba76-a6dbef318235 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:12.296573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd37ef-a263-4a33-ba76-a6dbef318235 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:12.296846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd37ef-a263-4a33-ba76-a6dbef318235 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:12.323380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd37ef-a263-4a33-ba76-a6dbef318235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:12.326427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 195/384] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:12.327833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfb31a-d0f4-4e62-9afa-a0831ec1c27c None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:12.328117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfb31a-d0f4-4e62-9afa-a0831ec1c27c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:12.328389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfb31a-d0f4-4e62-9afa-a0831ec1c27c None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:12.329625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 196/385] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-8fcd37ef-a263-4a33-ba76-a6dbef318235 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:12.330806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:12.331695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:12.332680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:12.339434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 190/386] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:12.339577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997aa097-76ec-4ac1-b59c-494417e31d59 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:12.339577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997aa097-76ec-4ac1-b59c-494417e31d59 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:12.339577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997aa097-76ec-4ac1-b59c-494417e31d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:12.341399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd37ef-a263-4a33-ba76-a6dbef318235 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:12.371968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-997aa097-76ec-4ac1-b59c-494417e31d59 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:12.373086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-997aa097-76ec-4ac1-b59c-494417e31d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:12.403842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:12.481883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd37ef-a263-4a33-ba76-a6dbef318235 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:12.482355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 197/387] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:12.554765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ca5c-03b4-44cc-8362-7ae2e412e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:12.555407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ca5c-03b4-44cc-8362-7ae2e412e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:12.555690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ca5c-03b4-44cc-8362-7ae2e412e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:12.555963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1ca5c-03b4-44cc-8362-7ae2e412e5d5 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:12.556715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1ca5c-03b4-44cc-8362-7ae2e412e5d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:12.557026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1ca5c-03b4-44cc-8362-7ae2e412e5d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:12.558410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1ca5c-03b4-44cc-8362-7ae2e412e5d5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:12.571785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 191/388] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:12.577528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997aa097-76ec-4ac1-b59c-494417e31d59 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:12.616388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:12.699591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997aa097-76ec-4ac1-b59c-494417e31d59 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:12.736798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85dff9-cf4c-466c-b7dd-4ff08a19e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:12.737434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85dff9-cf4c-466c-b7dd-4ff08a19e545 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:12.737714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85dff9-cf4c-466c-b7dd-4ff08a19e545 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:12.738045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85dff9-cf4c-466c-b7dd-4ff08a19e545 None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:12.739664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85dff9-cf4c-466c-b7dd-4ff08a19e545 None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:12.741123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85dff9-cf4c-466c-b7dd-4ff08a19e545 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:12.743018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 198/389] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:12 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:12.748526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ca5c-03b4-44cc-8362-7ae2e412e5d5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:12.764120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85dff9-cf4c-466c-b7dd-4ff08a19e545 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:12.876804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:12.880399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1ca5c-03b4-44cc-8362-7ae2e412e5d5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:12.886334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:12.899780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85dff9-cf4c-466c-b7dd-4ff08a19e545 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:12.926817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd6a28-e314-480d-ba7d-60c082d2a841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:12.928151 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd6a28-e314-480d-ba7d-60c082d2a841 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:12.928872 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd6a28-e314-480d-ba7d-60c082d2a841 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:12.929285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd6a28-e314-480d-ba7d-60c082d2a841 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:12.931070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd6a28-e314-480d-ba7d-60c082d2a841 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:12.933544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd6a28-e314-480d-ba7d-60c082d2a841 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:12.939571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6ae5-d71d-4dd2-a38c-1f2a90047260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:12.939571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6ae5-d71d-4dd2-a38c-1f2a90047260 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:12.940375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6ae5-d71d-4dd2-a38c-1f2a90047260 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:12.940375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f6ae5-d71d-4dd2-a38c-1f2a90047260 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:12.940598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 192/390] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:12 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:12.942215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd6a28-e314-480d-ba7d-60c082d2a841 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:12.961579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f6ae5-d71d-4dd2-a38c-1f2a90047260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-0c8f6ae5-d71d-4dd2-a38c-1f2a90047260 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:12.969298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:12.970805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:12.971662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:12.974726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 199/391] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:40:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:12.975699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6ae5-d71d-4dd2-a38c-1f2a90047260 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:13.063611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd6a28-e314-480d-ba7d-60c082d2a841 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:13.088613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f6ae5-d71d-4dd2-a38c-1f2a90047260 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:13.102543 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e64948-1ea0-4b87-94cb-19827b773cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:13.103466 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e64948-1ea0-4b87-94cb-19827b773cd2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.103758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e64948-1ea0-4b87-94cb-19827b773cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.104246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e64948-1ea0-4b87-94cb-19827b773cd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.116209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e64948-1ea0-4b87-94cb-19827b773cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-f0e64948-1ea0-4b87-94cb-19827b773cd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:13.127005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:13.127968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:13.129440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 193/392] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:13.130244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e64948-1ea0-4b87-94cb-19827b773cd2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:13.131370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd385f-0868-4be6-ba70-7884dee6dc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:13.132282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd385f-0868-4be6-ba70-7884dee6dc41 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.132748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd385f-0868-4be6-ba70-7884dee6dc41 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.133307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd385f-0868-4be6-ba70-7884dee6dc41 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179/groups/131f425c486d468d9d2c4dd288ca4020/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.135931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd385f-0868-4be6-ba70-7884dee6dc41 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b45f2debc7148b79ed609906b98b179, group_id=131f425c486d468d9d2c4dd288ca4020, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:13.137601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd385f-0868-4be6-ba70-7884dee6dc41 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:13.161264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:13.211501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 200/393] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 19:40:12 2022] PUT /identity/v3/projects/5b45f2debc7148b79ed609906b98b179/groups/131f425c486d468d9d2c4dd288ca4020/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:13.213994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd385f-0868-4be6-ba70-7884dee6dc41 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:13.243204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:13.270816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e64948-1ea0-4b87-94cb-19827b773cd2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:13.323905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e77784-f356-40c9-a855-5e72974af8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:13.324573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e77784-f356-40c9-a855-5e72974af8ad None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.324856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e77784-f356-40c9-a855-5e72974af8ad None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.325131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e77784-f356-40c9-a855-5e72974af8ad None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.325870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e77784-f356-40c9-a855-5e72974af8ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:13.326183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e77784-f356-40c9-a855-5e72974af8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:13.327644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e77784-f356-40c9-a855-5e72974af8ad None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:13.341340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 194/394] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:13.341340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bd70-4fcc-43f2-8308-65fc301bcc67 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.341340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bd70-4fcc-43f2-8308-65fc301bcc67 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.341340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576bd70-4fcc-43f2-8308-65fc301bcc67 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.341340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 195/395] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:13.344145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bd70-4fcc-43f2-8308-65fc301bcc67 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:13.386488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd385f-0868-4be6-ba70-7884dee6dc41 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:13.453156 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ce84e-5aa2-4698-94b6-44f7445981f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:13.453780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ce84e-5aa2-4698-94b6-44f7445981f9 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.454054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ce84e-5aa2-4698-94b6-44f7445981f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.454321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ce84e-5aa2-4698-94b6-44f7445981f9 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.454993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ce84e-5aa2-4698-94b6-44f7445981f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:13.455316 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ce84e-5aa2-4698-94b6-44f7445981f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:13.456873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ce84e-5aa2-4698-94b6-44f7445981f9 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:13.470957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 201/396] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:13.470957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961c5d7-7fb6-47ab-9cee-70a9072cf5c9 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.470957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961c5d7-7fb6-47ab-9cee-70a9072cf5c9 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.470957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961c5d7-7fb6-47ab-9cee-70a9072cf5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.488350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-1961c5d7-7fb6-47ab-9cee-70a9072cf5c9 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:13.489214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:13.490213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1961c5d7-7fb6-47ab-9cee-70a9072cf5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:13.500857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576bd70-4fcc-43f2-8308-65fc301bcc67 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:13.541472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd1b32-6e9b-4cd4-aeca-06550200c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:13.542471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1b32-6e9b-4cd4-aeca-06550200c52a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.542932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1b32-6e9b-4cd4-aeca-06550200c52a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.543441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1b32-6e9b-4cd4-aeca-06550200c52a None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.544892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd1b32-6e9b-4cd4-aeca-06550200c52a None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:13.546501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd1b32-6e9b-4cd4-aeca-06550200c52a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:13.548786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 196/397] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:13 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:13.549720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd1b32-6e9b-4cd4-aeca-06550200c52a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:13.571041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 202/398] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:13.572112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961c5d7-7fb6-47ab-9cee-70a9072cf5c9 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:13.574575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:13.659387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd1b32-6e9b-4cd4-aeca-06550200c52a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:13.681534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961c5d7-7fb6-47ab-9cee-70a9072cf5c9 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:13.697618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d0277-b360-4168-8c01-67664f26c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:13.698523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d0277-b360-4168-8c01-67664f26c425 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.698978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d0277-b360-4168-8c01-67664f26c425 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.699473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d0277-b360-4168-8c01-67664f26c425 None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.700758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d0277-b360-4168-8c01-67664f26c425 None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:13.702539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d0277-b360-4168-8c01-67664f26c425 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:13.704754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 197/399] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:13 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:13.711269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d0277-b360-4168-8c01-67664f26c425 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:13.723984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f03a2-ea2c-4234-945a-62a46bf24156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:13.724928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f03a2-ea2c-4234-945a-62a46bf24156 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.725347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f03a2-ea2c-4234-945a-62a46bf24156 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.725768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f03a2-ea2c-4234-945a-62a46bf24156 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.727254 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f03a2-ea2c-4234-945a-62a46bf24156 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:13.728907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f03a2-ea2c-4234-945a-62a46bf24156 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:13.731098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 203/400] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:13 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:13.736829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f03a2-ea2c-4234-945a-62a46bf24156 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:13.770496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:13.815618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:13.855947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f03a2-ea2c-4234-945a-62a46bf24156 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:13.883164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d0277-b360-4168-8c01-67664f26c425 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:13.918721 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc014e0-559b-49a1-86a1-f41ed80055ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:13.919811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc014e0-559b-49a1-86a1-f41ed80055ce None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.920351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc014e0-559b-49a1-86a1-f41ed80055ce None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.920760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc014e0-559b-49a1-86a1-f41ed80055ce None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179/groups/131f425c486d468d9d2c4dd288ca4020/roles/25294da9af854bf181e95bc99a9818c8` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.921309 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3b8d9-c38b-4eb0-bbfd-70d380bdfc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:13.922038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3b8d9-c38b-4eb0-bbfd-70d380bdfc58 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:13.922414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3b8d9-c38b-4eb0-bbfd-70d380bdfc58 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:13.922780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3b8d9-c38b-4eb0-bbfd-70d380bdfc58 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:13.923742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc014e0-559b-49a1-86a1-f41ed80055ce None admin] RBAC: Authorizing `identity:create_grant(project_id=5b45f2debc7148b79ed609906b98b179, group_id=131f425c486d468d9d2c4dd288ca4020, role_id=25294da9af854bf181e95bc99a9818c8)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:13.924141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3b8d9-c38b-4eb0-bbfd-70d380bdfc58 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:13.926345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3b8d9-c38b-4eb0-bbfd-70d380bdfc58 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:13.926865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc014e0-559b-49a1-86a1-f41ed80055ce None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:13.928910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 198/401] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:13 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:13.929728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3b8d9-c38b-4eb0-bbfd-70d380bdfc58 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:13.999433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 204/402] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 19:40:13 2022] PUT /identity/v3/projects/5b45f2debc7148b79ed609906b98b179/groups/131f425c486d468d9d2c4dd288ca4020/roles/25294da9af854bf181e95bc99a9818c8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:14.000290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc014e0-559b-49a1-86a1-f41ed80055ce None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:14.041717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:14.051305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3b8d9-c38b-4eb0-bbfd-70d380bdfc58 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:14.098340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce2577-239a-477c-b641-eb4af7dc1473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:14.099772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2577-239a-477c-b641-eb4af7dc1473 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:14.100296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2577-239a-477c-b641-eb4af7dc1473 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:14.100821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2577-239a-477c-b641-eb4af7dc1473 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:14.113122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce2577-239a-477c-b641-eb4af7dc1473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-55ce2577-239a-477c-b641-eb4af7dc1473 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:14.120023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:14.120972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:14.121773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:14.124335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 199/403] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:40:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:14.131388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312ca1-d290-4d80-ba2b-faf44e63b372 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:14.132003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312ca1-d290-4d80-ba2b-faf44e63b372 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:14.132480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17312ca1-d290-4d80-ba2b-faf44e63b372 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:14.134762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 200/404] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:14.140975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb008c-4acf-4217-878f-c0c9ec7fbdbc None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:14.141650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb008c-4acf-4217-878f-c0c9ec7fbdbc None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:14.142121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb008c-4acf-4217-878f-c0c9ec7fbdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:14.144510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc014e0-559b-49a1-86a1-f41ed80055ce None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:14.163267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8dcb008c-4acf-4217-878f-c0c9ec7fbdbc None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:14.164560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8dcb008c-4acf-4217-878f-c0c9ec7fbdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:14.181402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:14.187030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fda3a-ab21-4621-b1f6-04c28ef2bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:14.188277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fda3a-ab21-4621-b1f6-04c28ef2bf46 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:14.188493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fda3a-ab21-4621-b1f6-04c28ef2bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:14.189094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fda3a-ab21-4621-b1f6-04c28ef2bf46 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640/groups/131f425c486d468d9d2c4dd288ca4020/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:14.191310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fda3a-ab21-4621-b1f6-04c28ef2bf46 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e41da4162ce4e9e826e0da589f2c640, group_id=131f425c486d468d9d2c4dd288ca4020, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:14.196377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fda3a-ab21-4621-b1f6-04c28ef2bf46 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:14.247841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 201/405] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:14.248697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb008c-4acf-4217-878f-c0c9ec7fbdbc None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:14.315844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 205/406] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 19:40:13 2022] PUT /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640/groups/131f425c486d468d9d2c4dd288ca4020/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:14.345152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:14.364644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb008c-4acf-4217-878f-c0c9ec7fbdbc None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:14.407124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8601-d41e-4b8d-ae4c-2195e0b7b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:14.410644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8601-d41e-4b8d-ae4c-2195e0b7b03b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:14.410644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8601-d41e-4b8d-ae4c-2195e0b7b03b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:14.410644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8601-d41e-4b8d-ae4c-2195e0b7b03b None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:14.410644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d8601-d41e-4b8d-ae4c-2195e0b7b03b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:14.410644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d8601-d41e-4b8d-ae4c-2195e0b7b03b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:14.411158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d8601-d41e-4b8d-ae4c-2195e0b7b03b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:14.421041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 202/407] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:14.427423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fda3a-ab21-4621-b1f6-04c28ef2bf46 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:14.567356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fda3a-ab21-4621-b1f6-04c28ef2bf46 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:14.600026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8601-d41e-4b8d-ae4c-2195e0b7b03b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:14.605531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361dbd4-3a0d-4387-87ec-de4445c44cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:14.606174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361dbd4-3a0d-4387-87ec-de4445c44cb8 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:14.606447 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361dbd4-3a0d-4387-87ec-de4445c44cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:14.606714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361dbd4-3a0d-4387-87ec-de4445c44cb8 None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:14.607843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361dbd4-3a0d-4387-87ec-de4445c44cb8 None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:14.609563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361dbd4-3a0d-4387-87ec-de4445c44cb8 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:14.611462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 206/408] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:14 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:14.617277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361dbd4-3a0d-4387-87ec-de4445c44cb8 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:14.702880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:14.710916 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8601-d41e-4b8d-ae4c-2195e0b7b03b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:14.746313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a69254-3131-4226-85b1-6578861b19d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:14.746998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a69254-3131-4226-85b1-6578861b19d0 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:14.747213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a69254-3131-4226-85b1-6578861b19d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:14.747506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a69254-3131-4226-85b1-6578861b19d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:14.750646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361dbd4-3a0d-4387-87ec-de4445c44cb8 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:14.759084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a69254-3131-4226-85b1-6578861b19d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-73a69254-3131-4226-85b1-6578861b19d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:14.766214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:14.767213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:14.768034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 203/409] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:14.773439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a69254-3131-4226-85b1-6578861b19d0 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:14.782613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:14.803943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c63ff-51f5-4a80-b881-aa6d6dbc0ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:14.804949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c63ff-51f5-4a80-b881-aa6d6dbc0ea1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:14.805420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c63ff-51f5-4a80-b881-aa6d6dbc0ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:14.805882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c63ff-51f5-4a80-b881-aa6d6dbc0ea1 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:14.811557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c63ff-51f5-4a80-b881-aa6d6dbc0ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:14.813602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c63ff-51f5-4a80-b881-aa6d6dbc0ea1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:14.815558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 207/410] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:14 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:14.821778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c63ff-51f5-4a80-b881-aa6d6dbc0ea1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:14.881479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a69254-3131-4226-85b1-6578861b19d0 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:14.918734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d471-af30-4432-a870-b09c8a177bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:14.919380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d471-af30-4432-a870-b09c8a177bcd None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:14.919657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d471-af30-4432-a870-b09c8a177bcd None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:14.919923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d471-af30-4432-a870-b09c8a177bcd None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:14.921190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d471-af30-4432-a870-b09c8a177bcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:14.921496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d471-af30-4432-a870-b09c8a177bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:14.923101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d471-af30-4432-a870-b09c8a177bcd None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:14.943731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 204/411] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:14.949443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d471-af30-4432-a870-b09c8a177bcd None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:14.999751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c63ff-51f5-4a80-b881-aa6d6dbc0ea1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:15.041859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:15.051895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:15.063365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170141-c95e-4c8a-9c2b-324fc02d5c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:15.067789 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170141-c95e-4c8a-9c2b-324fc02d5c27 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:15.068412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170141-c95e-4c8a-9c2b-324fc02d5c27 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:15.068884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170141-c95e-4c8a-9c2b-324fc02d5c27 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640/groups/131f425c486d468d9d2c4dd288ca4020/roles/25294da9af854bf181e95bc99a9818c8` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:15.071449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38170141-c95e-4c8a-9c2b-324fc02d5c27 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e41da4162ce4e9e826e0da589f2c640, group_id=131f425c486d468d9d2c4dd288ca4020, role_id=25294da9af854bf181e95bc99a9818c8)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:15.073180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38170141-c95e-4c8a-9c2b-324fc02d5c27 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:15.088655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d471-af30-4432-a870-b09c8a177bcd None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:15.124326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994bdd9-09de-43da-b61c-f63b5963f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:15.124960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994bdd9-09de-43da-b61c-f63b5963f731 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:15.125232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994bdd9-09de-43da-b61c-f63b5963f731 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:15.125556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994bdd9-09de-43da-b61c-f63b5963f731 None admin] PATH_INFO: `/v3/groups/8a08ede2bf12452e897d9dcac17669bc` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:15.126749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994bdd9-09de-43da-b61c-f63b5963f731 None admin] RBAC: Authorizing `identity:get_group(group_id=8a08ede2bf12452e897d9dcac17669bc)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:15.128299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994bdd9-09de-43da-b61c-f63b5963f731 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:15.130516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 205/412] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:14 2022] GET /identity/v3/groups/8a08ede2bf12452e897d9dcac17669bc => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:15.136905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994bdd9-09de-43da-b61c-f63b5963f731 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:15.202907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 208/413] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 19:40:14 2022] PUT /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640/groups/131f425c486d468d9d2c4dd288ca4020/roles/25294da9af854bf181e95bc99a9818c8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:40:15.252950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994bdd9-09de-43da-b61c-f63b5963f731 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:15.292677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03aaed6-45fe-417f-adec-00080201d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:15.293417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aaed6-45fe-417f-adec-00080201d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:15.293694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aaed6-45fe-417f-adec-00080201d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:15.293964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03aaed6-45fe-417f-adec-00080201d2b2 None admin] PATH_INFO: `/v3/projects/51271e31587049bcaa892f314e138418` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:15.295182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03aaed6-45fe-417f-adec-00080201d2b2 None admin] RBAC: Authorizing `identity:get_project(project_id=51271e31587049bcaa892f314e138418)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:15.296708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03aaed6-45fe-417f-adec-00080201d2b2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:15.298751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 206/414] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:15 2022] GET /identity/v3/projects/51271e31587049bcaa892f314e138418 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:15.304646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170141-c95e-4c8a-9c2b-324fc02d5c27 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:15.464752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170141-c95e-4c8a-9c2b-324fc02d5c27 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:15.503350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84700-1359-4c97-b8a7-ccf02ae7c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:15.504646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84700-1359-4c97-b8a7-ccf02ae7c0d8 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:15.505437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84700-1359-4c97-b8a7-ccf02ae7c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:15.505707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84700-1359-4c97-b8a7-ccf02ae7c0d8 None admin] PATH_INFO: `/v3/projects/51271e31587049bcaa892f314e138418/groups/8a08ede2bf12452e897d9dcac17669bc/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:15.508355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f84700-1359-4c97-b8a7-ccf02ae7c0d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=51271e31587049bcaa892f314e138418, group_id=8a08ede2bf12452e897d9dcac17669bc, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:15.509854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f84700-1359-4c97-b8a7-ccf02ae7c0d8 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:15.582008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20612f7-3c46-4bbd-8d1f-25e1e80bfe7d None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:15.582397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20612f7-3c46-4bbd-8d1f-25e1e80bfe7d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:15.582872 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20612f7-3c46-4bbd-8d1f-25e1e80bfe7d None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:15.584635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 207/415] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:15.589831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebe930-1345-4732-be88-1e30c3220b6c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:15.590175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebe930-1345-4732-be88-1e30c3220b6c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:15.590499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebe930-1345-4732-be88-1e30c3220b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:15.604141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:15.609584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 209/416] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Aug 22 19:40:15 2022] PUT /identity/v3/projects/51271e31587049bcaa892f314e138418/groups/8a08ede2bf12452e897d9dcac17669bc/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:15.628596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-fbebe930-1345-4732-be88-1e30c3220b6c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:15.630228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fbebe930-1345-4732-be88-1e30c3220b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:15.742272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 208/417] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:16.133199 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84700-1359-4c97-b8a7-ccf02ae7c0d8 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:16.190319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:16.256179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84700-1359-4c97-b8a7-ccf02ae7c0d8 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:16.308412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc5a1-70ff-47e7-ac5f-762059a6a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:16.309061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc5a1-70ff-47e7-ac5f-762059a6a318 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:16.309327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc5a1-70ff-47e7-ac5f-762059a6a318 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:16.309600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc5a1-70ff-47e7-ac5f-762059a6a318 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:16.332768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0cc5a1-70ff-47e7-ac5f-762059a6a318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-fb0cc5a1-70ff-47e7-ac5f-762059a6a318 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:16.337605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:16.338533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:16.339446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 210/418] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:16.344532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebe930-1345-4732-be88-1e30c3220b6c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:16.363823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40764e4-3f88-4e38-9b7d-a487eec7d7c0 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:16.364183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40764e4-3f88-4e38-9b7d-a487eec7d7c0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:16.364361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40764e4-3f88-4e38-9b7d-a487eec7d7c0 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:16.365970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 211/419] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:16.373612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad0bca-26c0-4fa6-92bd-87705d058d8b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:16.373888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad0bca-26c0-4fa6-92bd-87705d058d8b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:16.374160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad0bca-26c0-4fa6-92bd-87705d058d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:16.406458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-dfad0bca-26c0-4fa6-92bd-87705d058d8b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:16.407697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-dfad0bca-26c0-4fa6-92bd-87705d058d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:16.522868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebe930-1345-4732-be88-1e30c3220b6c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:16.553795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 212/420] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 22 19:40:16.594710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ad2e0-9e30-492b-be03-d16a38e33497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:16.595700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ad2e0-9e30-492b-be03-d16a38e33497 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:16.596210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ad2e0-9e30-492b-be03-d16a38e33497 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:16.596687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ad2e0-9e30-492b-be03-d16a38e33497 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:16.597645 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ad2e0-9e30-492b-be03-d16a38e33497 None admin] RBAC: Adding query filter params (name=member) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:16.598153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ad2e0-9e30-492b-be03-d16a38e33497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:16.599813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ad2e0-9e30-492b-be03-d16a38e33497 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:16.601455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:16.615317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 209/421] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:16.620759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad0bca-26c0-4fa6-92bd-87705d058d8b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:16.664315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:16.733454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad0bca-26c0-4fa6-92bd-87705d058d8b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:16.771147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6dd1d-c87c-4d94-ac63-08640e6c13a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:16.771783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6dd1d-c87c-4d94-ac63-08640e6c13a4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:16.772064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6dd1d-c87c-4d94-ac63-08640e6c13a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:16.772334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6dd1d-c87c-4d94-ac63-08640e6c13a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:16.845770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6dd1d-c87c-4d94-ac63-08640e6c13a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:16.847955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6dd1d-c87c-4d94-ac63-08640e6c13a4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:16.883213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:16.937090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78e8d0-7c01-414b-9665-57394dc658a2 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:16.937425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78e8d0-7c01-414b-9665-57394dc658a2 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:16.937633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78e8d0-7c01-414b-9665-57394dc658a2 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:16.939042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 210/422] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:40:16.947244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d9b0-c7eb-4d23-8cf5-3205b19b184c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:16.947536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d9b0-c7eb-4d23-8cf5-3205b19b184c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:16.947818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31d9b0-c7eb-4d23-8cf5-3205b19b184c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:16.968209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 213/423] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:16.969056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6dd1d-c87c-4d94-ac63-08640e6c13a4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:16.982355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-eb31d9b0-c7eb-4d23-8cf5-3205b19b184c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:16.983590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-eb31d9b0-c7eb-4d23-8cf5-3205b19b184c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:17.065115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 211/424] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:17.066008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31d9b0-c7eb-4d23-8cf5-3205b19b184c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:17.090881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6dd1d-c87c-4d94-ac63-08640e6c13a4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:17.155946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c536bf4-c652-48c0-913b-4391785065ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:17.156601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c536bf4-c652-48c0-913b-4391785065ab None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:17.156884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c536bf4-c652-48c0-913b-4391785065ab None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:17.157158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c536bf4-c652-48c0-913b-4391785065ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:17.160518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:17.173158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c536bf4-c652-48c0-913b-4391785065ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:17.187499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31d9b0-c7eb-4d23-8cf5-3205b19b184c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-4c536bf4-c652-48c0-913b-4391785065ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:17.187632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:17.188437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:17.189221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 214/425] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:40:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:17.191549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c536bf4-c652-48c0-913b-4391785065ab None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:17.207916 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:17.216997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1e70d-88b4-48f7-b0f0-75adda0b4f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:17.217629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1e70d-88b4-48f7-b0f0-75adda0b4f00 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:17.217907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1e70d-88b4-48f7-b0f0-75adda0b4f00 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:17.218176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1e70d-88b4-48f7-b0f0-75adda0b4f00 None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:17.220253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1e70d-88b4-48f7-b0f0-75adda0b4f00 None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:17.221888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1e70d-88b4-48f7-b0f0-75adda0b4f00 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:17.224663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 212/426] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:17 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:17.243115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1e70d-88b4-48f7-b0f0-75adda0b4f00 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:17.385937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c536bf4-c652-48c0-913b-4391785065ab None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:17.389706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1e70d-88b4-48f7-b0f0-75adda0b4f00 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:17.450368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634ff4b-e399-40e4-afa8-e0725ace3509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:17.451083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634ff4b-e399-40e4-afa8-e0725ace3509 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:17.451488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634ff4b-e399-40e4-afa8-e0725ace3509 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:17.451758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634ff4b-e399-40e4-afa8-e0725ace3509 None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:17.452972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634ff4b-e399-40e4-afa8-e0725ace3509 None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:17.453163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97a2f5-3802-4e26-9088-a7c69a17f930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:17.453773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97a2f5-3802-4e26-9088-a7c69a17f930 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:17.454044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97a2f5-3802-4e26-9088-a7c69a17f930 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:17.454311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97a2f5-3802-4e26-9088-a7c69a17f930 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:17.454414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634ff4b-e399-40e4-afa8-e0725ace3509 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:17.454980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97a2f5-3802-4e26-9088-a7c69a17f930 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:17.455312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97a2f5-3802-4e26-9088-a7c69a17f930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:17.456342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 213/427] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:17 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:17.457147 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634ff4b-e399-40e4-afa8-e0725ace3509 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:17.462724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97a2f5-3802-4e26-9088-a7c69a17f930 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:17.475410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 215/428] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:17.476289 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97a2f5-3802-4e26-9088-a7c69a17f930 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:17.546717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:17.548389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:17.597887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97a2f5-3802-4e26-9088-a7c69a17f930 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:17.604501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634ff4b-e399-40e4-afa8-e0725ace3509 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:17.642235 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6a7c1-68ed-45b6-b60e-67577e022058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:17.643074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6a7c1-68ed-45b6-b60e-67577e022058 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:17.643384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6a7c1-68ed-45b6-b60e-67577e022058 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:17.643652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6a7c1-68ed-45b6-b60e-67577e022058 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:17.645181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0513cd0-3da0-4756-8f75-3b9d70720346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:17.646070 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0513cd0-3da0-4756-8f75-3b9d70720346 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:17.646345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0513cd0-3da0-4756-8f75-3b9d70720346 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:17.647025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0513cd0-3da0-4756-8f75-3b9d70720346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:17.647817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0513cd0-3da0-4756-8f75-3b9d70720346 None admin] RBAC: Adding query filter params (group.id=131f425c486d468d9d2c4dd288ca4020, role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=5b45f2debc7148b79ed609906b98b179) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:17.648121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0513cd0-3da0-4756-8f75-3b9d70720346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:17.649958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0513cd0-3da0-4756-8f75-3b9d70720346 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:17.654830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6a7c1-68ed-45b6-b60e-67577e022058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:17.657526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 216/429] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:17 2022] GET /identity/v3/role_assignments?group.id=131f425c486d468d9d2c4dd288ca4020&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:17.658368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0513cd0-3da0-4756-8f75-3b9d70720346 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-54f6a7c1-68ed-45b6-b60e-67577e022058 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:17.669660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:17.671876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:17.673823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 214/430] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:17.688378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6a7c1-68ed-45b6-b60e-67577e022058 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:17.796592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0513cd0-3da0-4756-8f75-3b9d70720346 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:17.820740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6a7c1-68ed-45b6-b60e-67577e022058 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:17.831903 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:17.851976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326edbe-6bff-4c0b-8514-b238e01526e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:17.852978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326edbe-6bff-4c0b-8514-b238e01526e8 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:17.853258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326edbe-6bff-4c0b-8514-b238e01526e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:17.853535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326edbe-6bff-4c0b-8514-b238e01526e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:17.853971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:17.869951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f7d87-a884-465c-9870-07f625703301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:17.870686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7d87-a884-465c-9870-07f625703301 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:17.870964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7d87-a884-465c-9870-07f625703301 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:17.871260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7d87-a884-465c-9870-07f625703301 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:17.871936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f7d87-a884-465c-9870-07f625703301 None admin] RBAC: Adding query filter params (name=member) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:17.872238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f7d87-a884-465c-9870-07f625703301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:17.873634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f7d87-a884-465c-9870-07f625703301 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:17.885196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 215/431] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:40:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:17.888913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8ba51-af29-4d2d-ad31-0ed46dd6c298 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:17.889860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8ba51-af29-4d2d-ad31-0ed46dd6c298 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:17.890465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8ba51-af29-4d2d-ad31-0ed46dd6c298 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:17.892436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 216/432] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:17.893361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8ba51-af29-4d2d-ad31-0ed46dd6c298 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:17.948198 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326edbe-6bff-4c0b-8514-b238e01526e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:17.949678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326edbe-6bff-4c0b-8514-b238e01526e8 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:18.012599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8ba51-af29-4d2d-ad31-0ed46dd6c298 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:18.059621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94179046-02ff-4375-99fe-768c98478ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:18.060511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179046-02ff-4375-99fe-768c98478ada None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.061000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179046-02ff-4375-99fe-768c98478ada None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.061269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94179046-02ff-4375-99fe-768c98478ada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.069543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 217/433] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:18.070812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee13fa5-01ff-4b67-a67f-f5445ddfb24e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.071638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee13fa5-01ff-4b67-a67f-f5445ddfb24e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.071919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee13fa5-01ff-4b67-a67f-f5445ddfb24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.094133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-5ee13fa5-01ff-4b67-a67f-f5445ddfb24e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:18.095349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5ee13fa5-01ff-4b67-a67f-f5445ddfb24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:18.116180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:18.120985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:18.136410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94179046-02ff-4375-99fe-768c98478ada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:18.137901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94179046-02ff-4375-99fe-768c98478ada None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:18.167089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 218/434] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:18.175485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05dace-d773-428b-86cd-4c97c5a6f798 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.175485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05dace-d773-428b-86cd-4c97c5a6f798 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.175485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05dace-d773-428b-86cd-4c97c5a6f798 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.175485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 219/435] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:18.175485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05dace-d773-428b-86cd-4c97c5a6f798 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:18.248524 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 217/436] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:18.249846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff159498-2b11-4a82-9b90-a4e8f91de649 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.250132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff159498-2b11-4a82-9b90-a4e8f91de649 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.250404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff159498-2b11-4a82-9b90-a4e8f91de649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.270655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ff159498-2b11-4a82-9b90-a4e8f91de649 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:18.271903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ff159498-2b11-4a82-9b90-a4e8f91de649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:18.286350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05dace-d773-428b-86cd-4c97c5a6f798 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:18.324188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d783-6664-4745-a5f5-e6c2aea4bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:18.324765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d783-6664-4745-a5f5-e6c2aea4bbee None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.325045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d783-6664-4745-a5f5-e6c2aea4bbee None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.325313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d783-6664-4745-a5f5-e6c2aea4bbee None admin] PATH_INFO: `/v3/projects/5b45f2debc7148b79ed609906b98b179` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.326425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d783-6664-4745-a5f5-e6c2aea4bbee None admin] RBAC: Authorizing `identity:get_project(project_id=5b45f2debc7148b79ed609906b98b179)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:18.327895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d783-6664-4745-a5f5-e6c2aea4bbee None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:18.329544 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 220/437] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:18 2022] GET /identity/v3/projects/5b45f2debc7148b79ed609906b98b179 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:18.330295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d783-6664-4745-a5f5-e6c2aea4bbee None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:18.351481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 218/438] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:18.352774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff159498-2b11-4a82-9b90-a4e8f91de649 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:18.368232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:18.377751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:18.475519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff159498-2b11-4a82-9b90-a4e8f91de649 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:18.478375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d783-6664-4745-a5f5-e6c2aea4bbee None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:18.514293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197c18-a3e0-44bf-b9ec-2ff21a7419ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:18.515012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197c18-a3e0-44bf-b9ec-2ff21a7419ad None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.515390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197c18-a3e0-44bf-b9ec-2ff21a7419ad None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.515666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197c18-a3e0-44bf-b9ec-2ff21a7419ad None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.516782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2197c18-a3e0-44bf-b9ec-2ff21a7419ad None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:18.517806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab964adc-43b1-443a-8e67-abc04d0342f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:18.518228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2197c18-a3e0-44bf-b9ec-2ff21a7419ad None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:18.518439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964adc-43b1-443a-8e67-abc04d0342f8 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.518717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964adc-43b1-443a-8e67-abc04d0342f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.518986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab964adc-43b1-443a-8e67-abc04d0342f8 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.524919 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 219/439] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:18 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:18.525061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab964adc-43b1-443a-8e67-abc04d0342f8 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:18.525148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197c18-a3e0-44bf-b9ec-2ff21a7419ad None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:18.525219 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab964adc-43b1-443a-8e67-abc04d0342f8 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:18.525219 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 221/440] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:18 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:18.525719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab964adc-43b1-443a-8e67-abc04d0342f8 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:18.617052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:18.626204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:18.635387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197c18-a3e0-44bf-b9ec-2ff21a7419ad None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:18.638509 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab964adc-43b1-443a-8e67-abc04d0342f8 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:18.670591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398ab4-4ac5-44a5-bb4f-4cba06bc6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:18.671325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398ab4-4ac5-44a5-bb4f-4cba06bc6f12 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.671604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398ab4-4ac5-44a5-bb4f-4cba06bc6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.671868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398ab4-4ac5-44a5-bb4f-4cba06bc6f12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.674014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc20e3a-9dc3-4356-bccf-3056763c513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:18.674812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20e3a-9dc3-4356-bccf-3056763c513c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.675419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20e3a-9dc3-4356-bccf-3056763c513c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.675419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc20e3a-9dc3-4356-bccf-3056763c513c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.676600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc20e3a-9dc3-4356-bccf-3056763c513c None admin] RBAC: Adding query filter params (group.id=131f425c486d468d9d2c4dd288ca4020, role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=5b45f2debc7148b79ed609906b98b179) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:18.676972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc20e3a-9dc3-4356-bccf-3056763c513c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:18.678408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc20e3a-9dc3-4356-bccf-3056763c513c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:18.683521 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e398ab4-4ac5-44a5-bb4f-4cba06bc6f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:18.684348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 222/441] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:18 2022] GET /identity/v3/role_assignments?group.id=131f425c486d468d9d2c4dd288ca4020&scope.project.id=5b45f2debc7148b79ed609906b98b179&role.id=25294da9af854bf181e95bc99a9818c8 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:18.685036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc20e3a-9dc3-4356-bccf-3056763c513c None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-4e398ab4-4ac5-44a5-bb4f-4cba06bc6f12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:18.688299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:18.689270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:18.690071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 220/442] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:40:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:18.690910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398ab4-4ac5-44a5-bb4f-4cba06bc6f12 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:18.806649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc20e3a-9dc3-4356-bccf-3056763c513c None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:18.819656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398ab4-4ac5-44a5-bb4f-4cba06bc6f12 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:18.848827 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4c603-4078-4097-9ba3-9dc58c308378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:18.849846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4c603-4078-4097-9ba3-9dc58c308378 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.850686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4c603-4078-4097-9ba3-9dc58c308378 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.850686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4c603-4078-4097-9ba3-9dc58c308378 None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.851856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4c603-4078-4097-9ba3-9dc58c308378 None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:18.853868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4c603-4078-4097-9ba3-9dc58c308378 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:18.857927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 223/443] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:18 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:18.859009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4c603-4078-4097-9ba3-9dc58c308378 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:18.868126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220b8e4-2aba-4c64-aa6f-e589de476d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:18.868690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220b8e4-2aba-4c64-aa6f-e589de476d7e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:18.868962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220b8e4-2aba-4c64-aa6f-e589de476d7e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:18.869230 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220b8e4-2aba-4c64-aa6f-e589de476d7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:18.883570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220b8e4-2aba-4c64-aa6f-e589de476d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:18.886839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-0220b8e4-2aba-4c64-aa6f-e589de476d7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:18.888788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:18.889871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:18.890706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 221/444] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:18.891475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220b8e4-2aba-4c64-aa6f-e589de476d7e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:18.894782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:18.983125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4c603-4078-4097-9ba3-9dc58c308378 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.015937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220b8e4-2aba-4c64-aa6f-e589de476d7e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.029127 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603452ee-4762-44c7-9132-6ec721962560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.029743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603452ee-4762-44c7-9132-6ec721962560 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.030022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603452ee-4762-44c7-9132-6ec721962560 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.030284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603452ee-4762-44c7-9132-6ec721962560 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.030965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603452ee-4762-44c7-9132-6ec721962560 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:19.031289 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603452ee-4762-44c7-9132-6ec721962560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.032821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603452ee-4762-44c7-9132-6ec721962560 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.042796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 224/445] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:19.043694 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603452ee-4762-44c7-9132-6ec721962560 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:19.059516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c21984-dda2-4246-9405-8bd3650607d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.060223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21984-dda2-4246-9405-8bd3650607d1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.060572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21984-dda2-4246-9405-8bd3650607d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.060913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21984-dda2-4246-9405-8bd3650607d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.061763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c21984-dda2-4246-9405-8bd3650607d1 None admin] RBAC: Adding query filter params (group.id=131f425c486d468d9d2c4dd288ca4020, role.id=62d0acf1402140c5a97def31e7b912c7, scope.project.id=6e41da4162ce4e9e826e0da589f2c640) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:19.062168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c21984-dda2-4246-9405-8bd3650607d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.063743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c21984-dda2-4246-9405-8bd3650607d1 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.070403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 222/446] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:18 2022] GET /identity/v3/role_assignments?group.id=131f425c486d468d9d2c4dd288ca4020&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=62d0acf1402140c5a97def31e7b912c7 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:19.071397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c21984-dda2-4246-9405-8bd3650607d1 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:19.146042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:19.153619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:19.175731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603452ee-4762-44c7-9132-6ec721962560 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.185141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c21984-dda2-4246-9405-8bd3650607d1 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.218786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b42020-f181-4494-823c-86f6cc0316bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.219429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b42020-f181-4494-823c-86f6cc0316bf None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.219705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b42020-f181-4494-823c-86f6cc0316bf None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.220600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b42020-f181-4494-823c-86f6cc0316bf None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.220600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b42020-f181-4494-823c-86f6cc0316bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:19.220914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b42020-f181-4494-823c-86f6cc0316bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.222902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b42020-f181-4494-823c-86f6cc0316bf None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.231597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c98834-f660-44ec-9eff-431e4d7e4e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.232261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c98834-f660-44ec-9eff-431e4d7e4e17 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.232724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c98834-f660-44ec-9eff-431e4d7e4e17 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.233046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c98834-f660-44ec-9eff-431e4d7e4e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.233567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 225/447] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:19.239591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b42020-f181-4494-823c-86f6cc0316bf None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:19.322653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c98834-f660-44ec-9eff-431e4d7e4e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.324206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c98834-f660-44ec-9eff-431e4d7e4e17 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.372128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b42020-f181-4494-823c-86f6cc0316bf None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.410542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:19.424323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97141486-6f53-4b98-a86e-37bcd608da37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.425005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97141486-6f53-4b98-a86e-37bcd608da37 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.425313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97141486-6f53-4b98-a86e-37bcd608da37 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.426217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97141486-6f53-4b98-a86e-37bcd608da37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.443911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:19.451296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 223/448] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:19.457979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c98834-f660-44ec-9eff-431e4d7e4e17 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:19.498887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97141486-6f53-4b98-a86e-37bcd608da37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.500374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97141486-6f53-4b98-a86e-37bcd608da37 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.556638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c98834-f660-44ec-9eff-431e4d7e4e17 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.591175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd0c73-cb41-462c-88e3-112f2ee7f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.591852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd0c73-cb41-462c-88e3-112f2ee7f910 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.592124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd0c73-cb41-462c-88e3-112f2ee7f910 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.592387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd0c73-cb41-462c-88e3-112f2ee7f910 None admin] PATH_INFO: `/v3/projects/6e41da4162ce4e9e826e0da589f2c640` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.593496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd0c73-cb41-462c-88e3-112f2ee7f910 None admin] RBAC: Authorizing `identity:get_project(project_id=6e41da4162ce4e9e826e0da589f2c640)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.594961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd0c73-cb41-462c-88e3-112f2ee7f910 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.596592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 224/449] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:19 2022] GET /identity/v3/projects/6e41da4162ce4e9e826e0da589f2c640 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:19.601434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 226/450] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 19:40:19.602033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd0c73-cb41-462c-88e3-112f2ee7f910 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:19.606872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97141486-6f53-4b98-a86e-37bcd608da37 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:19.636460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:19.652398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:19.704803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd0c73-cb41-462c-88e3-112f2ee7f910 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.706128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97141486-6f53-4b98-a86e-37bcd608da37 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.738894 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f294d64-0141-49a5-9119-9ebb27081743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.739111 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12632-288a-4970-8c9f-c8ed80089fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.739542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f294d64-0141-49a5-9119-9ebb27081743 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.739638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12632-288a-4970-8c9f-c8ed80089fab None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.739816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f294d64-0141-49a5-9119-9ebb27081743 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.739922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12632-288a-4970-8c9f-c8ed80089fab None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.740083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f294d64-0141-49a5-9119-9ebb27081743 None admin] PATH_INFO: `/v3/groups/131f425c486d468d9d2c4dd288ca4020` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.740171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12632-288a-4970-8c9f-c8ed80089fab None admin] PATH_INFO: `/v3/projects/51271e31587049bcaa892f314e138418` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.741193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f294d64-0141-49a5-9119-9ebb27081743 None admin] RBAC: Authorizing `identity:get_group(group_id=131f425c486d468d9d2c4dd288ca4020)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.741295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12632-288a-4970-8c9f-c8ed80089fab None admin] RBAC: Authorizing `identity:get_project(project_id=51271e31587049bcaa892f314e138418)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.742636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f294d64-0141-49a5-9119-9ebb27081743 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.742733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12632-288a-4970-8c9f-c8ed80089fab None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.744237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 225/451] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:19 2022] GET /identity/v3/groups/131f425c486d468d9d2c4dd288ca4020 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:19.748760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 227/452] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:40:19 2022] GET /identity/v3/projects/51271e31587049bcaa892f314e138418 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:19.749699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12632-288a-4970-8c9f-c8ed80089fab None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:19.749803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f294d64-0141-49a5-9119-9ebb27081743 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:19.851057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12632-288a-4970-8c9f-c8ed80089fab None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.852351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f294d64-0141-49a5-9119-9ebb27081743 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:19.853887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:19.866043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:19.887491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da7ba3-e7f7-466e-a5ab-af0eff88eef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.887651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5357a6-3ec0-4b26-9685-b461ec6ace98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:19.892348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7ba3-e7f7-466e-a5ab-af0eff88eef3 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.892467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5357a6-3ec0-4b26-9685-b461ec6ace98 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:19.892581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7ba3-e7f7-466e-a5ab-af0eff88eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.892692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5357a6-3ec0-4b26-9685-b461ec6ace98 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:19.892771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7ba3-e7f7-466e-a5ab-af0eff88eef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.892839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5357a6-3ec0-4b26-9685-b461ec6ace98 None admin] PATH_INFO: `/v3/groups/8a08ede2bf12452e897d9dcac17669bc` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:19.892920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da7ba3-e7f7-466e-a5ab-af0eff88eef3 None admin] RBAC: Adding query filter params (group.id=131f425c486d468d9d2c4dd288ca4020, role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=6e41da4162ce4e9e826e0da589f2c640) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:19.892920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da7ba3-e7f7-466e-a5ab-af0eff88eef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.893081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5357a6-3ec0-4b26-9685-b461ec6ace98 None admin] RBAC: Authorizing `identity:get_group(group_id=8a08ede2bf12452e897d9dcac17669bc)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:19.893147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da7ba3-e7f7-466e-a5ab-af0eff88eef3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.893212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5357a6-3ec0-4b26-9685-b461ec6ace98 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:19.893212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 226/453] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Aug 22 19:40:19 2022] GET /identity/v3/groups/8a08ede2bf12452e897d9dcac17669bc => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:19.898378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 228/454] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:19 2022] GET /identity/v3/role_assignments?group.id=131f425c486d468d9d2c4dd288ca4020&scope.project.id=6e41da4162ce4e9e826e0da589f2c640&role.id=25294da9af854bf181e95bc99a9818c8 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:19.899038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5357a6-3ec0-4b26-9685-b461ec6ace98 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:20.009660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5357a6-3ec0-4b26-9685-b461ec6ace98 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:20.045473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76449d5-94a5-47ae-8f0e-9d9171096fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:20.046087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76449d5-94a5-47ae-8f0e-9d9171096fd1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:20.046360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76449d5-94a5-47ae-8f0e-9d9171096fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:20.046629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76449d5-94a5-47ae-8f0e-9d9171096fd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:20.047428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76449d5-94a5-47ae-8f0e-9d9171096fd1 None admin] RBAC: Adding query filter params (group.id=8a08ede2bf12452e897d9dcac17669bc, role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=51271e31587049bcaa892f314e138418) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:20.048665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76449d5-94a5-47ae-8f0e-9d9171096fd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:20.049171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76449d5-94a5-47ae-8f0e-9d9171096fd1 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:20.056075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 227/455] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Aug 22 19:40:19 2022] GET /identity/v3/role_assignments?group.id=8a08ede2bf12452e897d9dcac17669bc&scope.project.id=51271e31587049bcaa892f314e138418&role.id=9ec7f759c0a64655b794dfb597930076 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:22.348825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc7783-1b97-418a-b10d-45e91d5b4b82 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:22.349391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc7783-1b97-418a-b10d-45e91d5b4b82 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:22.349391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc7783-1b97-418a-b10d-45e91d5b4b82 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:22.351067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 229/456] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:22.357350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa466d0-7b1f-463a-9432-55ba4e2c214e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:22.357865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa466d0-7b1f-463a-9432-55ba4e2c214e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:22.357865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa466d0-7b1f-463a-9432-55ba4e2c214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:22.379705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-1fa466d0-7b1f-463a-9432-55ba4e2c214e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:22.381206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1fa466d0-7b1f-463a-9432-55ba4e2c214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:22.422568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:22.484576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 228/457] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:22.807482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc7783-1b97-418a-b10d-45e91d5b4b82 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:22.864958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c4a8e-ff5b-4b3d-9848-c5b352518aed None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:22.865230 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c4a8e-ff5b-4b3d-9848-c5b352518aed None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:22.865786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c4a8e-ff5b-4b3d-9848-c5b352518aed None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:22.867596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 229/458] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:22.880971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22337b-38be-45c4-b0b5-b736117e5d28 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:22.881583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22337b-38be-45c4-b0b5-b736117e5d28 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:22.882070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22337b-38be-45c4-b0b5-b736117e5d28 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:22.884014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 230/459] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:22.885716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f05baa-56cb-4209-8a1f-67c2071d1cb6 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:22.886192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f05baa-56cb-4209-8a1f-67c2071d1cb6 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:22.886765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f05baa-56cb-4209-8a1f-67c2071d1cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:22.906875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-a4f05baa-56cb-4209-8a1f-67c2071d1cb6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:22.908424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a4f05baa-56cb-4209-8a1f-67c2071d1cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:22.953945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc7783-1b97-418a-b10d-45e91d5b4b82 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:22.984334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 231/460] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:22.985987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00ae7f-168e-4a9c-a12c-a69544e7581e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:22.986491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00ae7f-168e-4a9c-a12c-a69544e7581e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:22.986966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00ae7f-168e-4a9c-a12c-a69544e7581e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:23.008106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653860dd-b475-48eb-a25a-5bd5c1d7851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:23.008747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653860dd-b475-48eb-a25a-5bd5c1d7851f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:23.009026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653860dd-b475-48eb-a25a-5bd5c1d7851f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:23.009369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653860dd-b475-48eb-a25a-5bd5c1d7851f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:23.021889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653860dd-b475-48eb-a25a-5bd5c1d7851f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:23.023675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653860dd-b475-48eb-a25a-5bd5c1d7851f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:23.032093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ae00ae7f-168e-4a9c-a12c-a69544e7581e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:23.033596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ae00ae7f-168e-4a9c-a12c-a69544e7581e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-653860dd-b475-48eb-a25a-5bd5c1d7851f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:23.056920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:23.057926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:23.058797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:23.058797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:23.058797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:23.067583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 230/461] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:23.073454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653860dd-b475-48eb-a25a-5bd5c1d7851f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:23.132754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:23.171570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 232/462] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:23.231270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653860dd-b475-48eb-a25a-5bd5c1d7851f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:23.267713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757814a3-70dd-413a-bbfa-ccd82c6bb9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:23.268659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757814a3-70dd-413a-bbfa-ccd82c6bb9cc None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:23.269196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757814a3-70dd-413a-bbfa-ccd82c6bb9cc None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:23.269680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757814a3-70dd-413a-bbfa-ccd82c6bb9cc None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:23.270519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757814a3-70dd-413a-bbfa-ccd82c6bb9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:23.271020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757814a3-70dd-413a-bbfa-ccd82c6bb9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:23.272712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757814a3-70dd-413a-bbfa-ccd82c6bb9cc None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:23.285971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 231/463] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:23.291380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00ae7f-168e-4a9c-a12c-a69544e7581e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:23.312801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757814a3-70dd-413a-bbfa-ccd82c6bb9cc None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:23.337639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:23.419594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:23.433802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757814a3-70dd-413a-bbfa-ccd82c6bb9cc None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:23.476142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe155111-2382-454d-8d97-7d527ec3ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:23.477567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe155111-2382-454d-8d97-7d527ec3ed5b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:23.478056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe155111-2382-454d-8d97-7d527ec3ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:23.478695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe155111-2382-454d-8d97-7d527ec3ed5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:23.493741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe155111-2382-454d-8d97-7d527ec3ed5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:23.494009 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00ae7f-168e-4a9c-a12c-a69544e7581e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:23.495455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe155111-2382-454d-8d97-7d527ec3ed5b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-fe155111-2382-454d-8d97-7d527ec3ed5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:23.515109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:23.516125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:23.516994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:23.516994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:23.516994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:23.516994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 232/464] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:23.518131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1913f-8576-4449-b28d-b0fb2c134f3b None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:23.518421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1913f-8576-4449-b28d-b0fb2c134f3b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:23.518695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1913f-8576-4449-b28d-b0fb2c134f3b None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:23.520681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 233/465] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:23.521587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1913f-8576-4449-b28d-b0fb2c134f3b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:23.540332 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac6df7-417d-447f-aeee-9d30549e80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:23.540944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac6df7-417d-447f-aeee-9d30549e80f2 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:23.541217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac6df7-417d-447f-aeee-9d30549e80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:23.541488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac6df7-417d-447f-aeee-9d30549e80f2 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:23.542140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac6df7-417d-447f-aeee-9d30549e80f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:23.543625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac6df7-417d-447f-aeee-9d30549e80f2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:23.639109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1913f-8576-4449-b28d-b0fb2c134f3b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:23.647149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 233/466] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:40:23 2022] POST /identity/v3/users => generated 246 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:40:23.656732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac6df7-417d-447f-aeee-9d30549e80f2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:23.683836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d2eb5-93a3-42d5-85ac-4ade29b88754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:23.684617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d2eb5-93a3-42d5-85ac-4ade29b88754 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:23.684899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d2eb5-93a3-42d5-85ac-4ade29b88754 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:23.685214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d2eb5-93a3-42d5-85ac-4ade29b88754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:23.698601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:23.701883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d2eb5-93a3-42d5-85ac-4ade29b88754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:23.703748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d2eb5-93a3-42d5-85ac-4ade29b88754 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-9c9d2eb5-93a3-42d5-85ac-4ade29b88754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:23.724522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:23.725496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:23.726340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:23.726340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:23.726340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:23.731016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 234/467] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:23.732705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3ee7-84d0-462c-85c6-7b82b9ca08ec None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:23.732993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3ee7-84d0-462c-85c6-7b82b9ca08ec None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:23.733269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3ee7-84d0-462c-85c6-7b82b9ca08ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:23.759202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-70ae3ee7-84d0-462c-85c6-7b82b9ca08ec None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:23.761479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-70ae3ee7-84d0-462c-85c6-7b82b9ca08ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:23.782504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:23.808575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac6df7-417d-447f-aeee-9d30549e80f2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:23.850768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 235/468] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:23.852030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae3ee7-84d0-462c-85c6-7b82b9ca08ec None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:23.858707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e861e14-f562-487b-92ff-0ac39c243462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:23.859436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861e14-f562-487b-92ff-0ac39c243462 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:23.859787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861e14-f562-487b-92ff-0ac39c243462 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:23.860129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e861e14-f562-487b-92ff-0ac39c243462 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:23.860857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861e14-f562-487b-92ff-0ac39c243462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:23.861229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861e14-f562-487b-92ff-0ac39c243462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:23.862839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e861e14-f562-487b-92ff-0ac39c243462 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:23.877577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 234/469] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:23.883844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e861e14-f562-487b-92ff-0ac39c243462 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:23.991587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae3ee7-84d0-462c-85c6-7b82b9ca08ec None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:24.007722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e861e14-f562-487b-92ff-0ac39c243462 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:24.030821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:24.055549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314ce8c-f8cb-4890-91d0-b502f4656c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:24.056166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314ce8c-f8cb-4890-91d0-b502f4656c77 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:24.056441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314ce8c-f8cb-4890-91d0-b502f4656c77 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:24.056713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314ce8c-f8cb-4890-91d0-b502f4656c77 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:24.057365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314ce8c-f8cb-4890-91d0-b502f4656c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:24.057664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314ce8c-f8cb-4890-91d0-b502f4656c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:24.059047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314ce8c-f8cb-4890-91d0-b502f4656c77 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:24.079436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ab52-6aee-4861-96d5-00bf3e992107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:24.080053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ab52-6aee-4861-96d5-00bf3e992107 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:24.080333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ab52-6aee-4861-96d5-00bf3e992107 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:24.080602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ab52-6aee-4861-96d5-00bf3e992107 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:24.081265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ab52-6aee-4861-96d5-00bf3e992107 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:24.082773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ab52-6aee-4861-96d5-00bf3e992107 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:24.086557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 236/470] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:24.096615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3269ce-3e84-46e3-b246-6cfbced83ac2 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:24.096901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3269ce-3e84-46e3-b246-6cfbced83ac2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:24.097758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3269ce-3e84-46e3-b246-6cfbced83ac2 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:24.100058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 237/471] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:24.100784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3269ce-3e84-46e3-b246-6cfbced83ac2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:24.105115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:24.207084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 235/472] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:40:23 2022] POST /identity/v3/users => generated 248 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:40:24.211323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3269ce-3e84-46e3-b246-6cfbced83ac2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:24.217084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2ad5-78a3-4956-b693-a989a325c69b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:24.217418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2ad5-78a3-4956-b693-a989a325c69b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:24.217701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2ad5-78a3-4956-b693-a989a325c69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:24.248460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e74e2ad5-78a3-4956-b693-a989a325c69b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:24.250205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e74e2ad5-78a3-4956-b693-a989a325c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:24.260656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037bbfa-0442-49cd-abdf-137a8e127cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:24.262472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037bbfa-0442-49cd-abdf-137a8e127cc1 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:24.263007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037bbfa-0442-49cd-abdf-137a8e127cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:24.263531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037bbfa-0442-49cd-abdf-137a8e127cc1 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:24.265196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037bbfa-0442-49cd-abdf-137a8e127cc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:24.267997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037bbfa-0442-49cd-abdf-137a8e127cc1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:24.339094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 236/473] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:24.340382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e2ad5-78a3-4956-b693-a989a325c69b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:24.391998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 238/474] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:40:24 2022] POST /identity/v3/users => generated 248 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:40:24.474955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e2ad5-78a3-4956-b693-a989a325c69b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:24.506768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:24.516817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006e529-e27a-42f3-bfe5-7e194555eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:24.521186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006e529-e27a-42f3-bfe5-7e194555eeac None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:24.521186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006e529-e27a-42f3-bfe5-7e194555eeac None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:24.521186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006e529-e27a-42f3-bfe5-7e194555eeac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:24.530864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006e529-e27a-42f3-bfe5-7e194555eeac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:24.532558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006e529-e27a-42f3-bfe5-7e194555eeac None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-7006e529-e27a-42f3-bfe5-7e194555eeac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:24.552185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:24.553143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:24.553987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:24.553987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:24.553987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:24.553987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 237/475] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:24.564418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037bbfa-0442-49cd-abdf-137a8e127cc1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:24.614100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:24.647997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006e529-e27a-42f3-bfe5-7e194555eeac None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:24.690016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037bbfa-0442-49cd-abdf-137a8e127cc1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:24.735580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90530fb8-bacd-420b-9a44-269fe82bab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:24.736292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90530fb8-bacd-420b-9a44-269fe82bab11 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:24.736628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90530fb8-bacd-420b-9a44-269fe82bab11 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:24.736979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90530fb8-bacd-420b-9a44-269fe82bab11 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:24.737978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90530fb8-bacd-420b-9a44-269fe82bab11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:24.738394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90530fb8-bacd-420b-9a44-269fe82bab11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:24.740240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90530fb8-bacd-420b-9a44-269fe82bab11 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:24.755724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 239/476] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:24.762398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90530fb8-bacd-420b-9a44-269fe82bab11 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:24.772145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006e529-e27a-42f3-bfe5-7e194555eeac None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:24.821433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:24.822321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:24.822754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:24.823167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:24.824019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:24.825557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:24.867893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.sql.core [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 19:40:24.867893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 19:40:24.867893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [parameters: {'id': 'fa2b787dfed04f45a827f5a313830e7f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 19:40:24.867893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93485) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 19:40:24.875859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:24.881269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90530fb8-bacd-420b-9a44-269fe82bab11 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application conn.query(q) Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application result.read() Aug 22 19:40:24.888925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return ref.to_dict() Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 19:40:24.894682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application next(self.gen) Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application yield resource Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application next(self.gen) Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise self.value Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application session.commit() Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 19:40:24.895718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.session.flush() Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application compat.raise_( Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 19:40:24.896577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 19:40:24.897460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application conn.query(q) Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application result.read() Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 19:40:24.898278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [parameters: {'id': 'fa2b787dfed04f45a827f5a313830e7f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:24.899142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 19:40:24.905402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:24.908390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 238/477] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 19:40:24 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:24.908390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:24.940610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6ec7-6e08-4f42-86c7-36d5c9b6a6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:24.941825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6ec7-6e08-4f42-86c7-36d5c9b6a6af None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:24.942266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6ec7-6e08-4f42-86c7-36d5c9b6a6af None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:24.943898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b6ec7-6e08-4f42-86c7-36d5c9b6a6af None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:24.944611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b6ec7-6e08-4f42-86c7-36d5c9b6a6af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:24.946182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b6ec7-6e08-4f42-86c7-36d5c9b6a6af None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:25.017977 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:25.047363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb09a13-0533-4e05-a6be-ec075b78e4b6 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:25.083250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4280fb-6422-4525-a924-fbc5c509c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:25.084213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4280fb-6422-4525-a924-fbc5c509c2fb None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:25.084669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4280fb-6422-4525-a924-fbc5c509c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:25.085110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4280fb-6422-4525-a924-fbc5c509c2fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:25.096780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4280fb-6422-4525-a924-fbc5c509c2fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:25.098622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 240/478] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:40:24 2022] POST /identity/v3/users => generated 249 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-6c4280fb-6422-4525-a924-fbc5c509c2fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:25.103593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:25.104542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 19:40:25.105385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:25.108087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 239/479] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:40:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:25.115479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6ec7-6e08-4f42-86c7-36d5c9b6a6af None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:25.253948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b6ec7-6e08-4f42-86c7-36d5c9b6a6af None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:25.297259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1917f3-d622-4ec6-872b-3b751c82d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:25.297807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1917f3-d622-4ec6-872b-3b751c82d845 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:25.298079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1917f3-d622-4ec6-872b-3b751c82d845 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:25.298347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1917f3-d622-4ec6-872b-3b751c82d845 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:25.299025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1917f3-d622-4ec6-872b-3b751c82d845 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:25.299357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1917f3-d622-4ec6-872b-3b751c82d845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:25.301350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1917f3-d622-4ec6-872b-3b751c82d845 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:25.315871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 241/480] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:25.935051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c3504-d101-41a3-a3dd-db4bd414242e None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:25.936120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c3504-d101-41a3-a3dd-db4bd414242e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:25.936603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c3504-d101-41a3-a3dd-db4bd414242e None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:25.938588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 240/481] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:25.944707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ea21-21b7-476f-b960-efe9227259db None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:25.945549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ea21-21b7-476f-b960-efe9227259db None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:25.946024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ea21-21b7-476f-b960-efe9227259db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:25.972272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-c826ea21-21b7-476f-b960-efe9227259db None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:25.973814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c826ea21-21b7-476f-b960-efe9227259db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:25.989018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:26.063373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 242/482] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:26.448281 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c3504-d101-41a3-a3dd-db4bd414242e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:26.557969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c3504-d101-41a3-a3dd-db4bd414242e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:26.559605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:26.593852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a8387-898d-42af-b5bd-4cbd98553d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:26.594496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8387-898d-42af-b5bd-4cbd98553d71 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:26.594779 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8387-898d-42af-b5bd-4cbd98553d71 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:26.595053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8387-898d-42af-b5bd-4cbd98553d71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:26.606218 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a8387-898d-42af-b5bd-4cbd98553d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-e26a8387-898d-42af-b5bd-4cbd98553d71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:26.610950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:26.611859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:26.613202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:26.617400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 241/483] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:26.618773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ea21-21b7-476f-b960-efe9227259db None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:26.710733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4cfa-930c-4d7a-bff9-4a88405cef68 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:26.711058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4cfa-930c-4d7a-bff9-4a88405cef68 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:26.711299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4cfa-930c-4d7a-bff9-4a88405cef68 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:26.713252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 242/484] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:40:26.720441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c5fe-fea3-46ee-ab4c-8600bc393a0d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:26.720705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c5fe-fea3-46ee-ab4c-8600bc393a0d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:26.720980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c5fe-fea3-46ee-ab4c-8600bc393a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:26.729827 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ea21-21b7-476f-b960-efe9227259db None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:26.749060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-33d4c5fe-fea3-46ee-ab4c-8600bc393a0d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:26.750261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-33d4c5fe-fea3-46ee-ab4c-8600bc393a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:26.766935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03905dc-dcd8-4a4a-b918-ef5fcba327e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:26.767921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03905dc-dcd8-4a4a-b918-ef5fcba327e4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:26.768421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03905dc-dcd8-4a4a-b918-ef5fcba327e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:26.768919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03905dc-dcd8-4a4a-b918-ef5fcba327e4 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:26.769793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03905dc-dcd8-4a4a-b918-ef5fcba327e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:26.770293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03905dc-dcd8-4a4a-b918-ef5fcba327e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:26.771918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03905dc-dcd8-4a4a-b918-ef5fcba327e4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:26.781264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 243/485] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:26.787598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03905dc-dcd8-4a4a-b918-ef5fcba327e4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:26.803548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:26.884700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 243/486] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:26.953983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03905dc-dcd8-4a4a-b918-ef5fcba327e4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:26.998558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303930-622c-4678-8eae-f03a042c21f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:26.999182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303930-622c-4678-8eae-f03a042c21f7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:26.999493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303930-622c-4678-8eae-f03a042c21f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:26.999820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96303930-622c-4678-8eae-f03a042c21f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.014540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96303930-622c-4678-8eae-f03a042c21f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:27.016100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96303930-622c-4678-8eae-f03a042c21f7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-96303930-622c-4678-8eae-f03a042c21f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:27.033556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:27.035051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:27.036032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:27.036032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:27.036032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:27.036032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 244/487] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:27.042112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c5fe-fea3-46ee-ab4c-8600bc393a0d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:27.159487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:27.173338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c5fe-fea3-46ee-ab4c-8600bc393a0d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:27.219939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac64c0-a84f-40f5-93bb-1a5b4d9e74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:27.220559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac64c0-a84f-40f5-93bb-1a5b4d9e74cc None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.220840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac64c0-a84f-40f5-93bb-1a5b4d9e74cc None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.221108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac64c0-a84f-40f5-93bb-1a5b4d9e74cc None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.221763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac64c0-a84f-40f5-93bb-1a5b4d9e74cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:27.222302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac64c0-a84f-40f5-93bb-1a5b4d9e74cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:27.223775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac64c0-a84f-40f5-93bb-1a5b4d9e74cc None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:27.238628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 244/488] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:27.244267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303930-622c-4678-8eae-f03a042c21f7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:27.305169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90d77-bb7f-4e63-a987-a4502ffd6549 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.305464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90d77-bb7f-4e63-a987-a4502ffd6549 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.305629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90d77-bb7f-4e63-a987-a4502ffd6549 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.311200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 245/489] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:27.312486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2d60-4fe6-4d04-af7a-6be237044e77 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.312768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2d60-4fe6-4d04-af7a-6be237044e77 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.313039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2d60-4fe6-4d04-af7a-6be237044e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.329638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:27.406268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0a6b2d60-4fe6-4d04-af7a-6be237044e77 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:27.406547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0a6b2d60-4fe6-4d04-af7a-6be237044e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:27.431124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96303930-622c-4678-8eae-f03a042c21f7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:27.468516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85bf36-cbe7-4eff-a2be-4f03b8747af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:27.469512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85bf36-cbe7-4eff-a2be-4f03b8747af1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.470002 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85bf36-cbe7-4eff-a2be-4f03b8747af1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.470470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85bf36-cbe7-4eff-a2be-4f03b8747af1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.480441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85bf36-cbe7-4eff-a2be-4f03b8747af1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:27.480898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 246/490] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:27.481768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2d60-4fe6-4d04-af7a-6be237044e77 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:27.482749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85bf36-cbe7-4eff-a2be-4f03b8747af1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-9b85bf36-cbe7-4eff-a2be-4f03b8747af1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:27.516946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:27.517894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:27.519368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:27.521844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 245/491] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 19:40:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:27.527435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85bf36-cbe7-4eff-a2be-4f03b8747af1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:27.631313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:27.654586 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2d60-4fe6-4d04-af7a-6be237044e77 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:27.667819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85bf36-cbe7-4eff-a2be-4f03b8747af1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:27.693633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:27.704103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1847-5cb2-4238-b1cb-560c25d05c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:27.704887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1847-5cb2-4238-b1cb-560c25d05c98 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.705162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1847-5cb2-4238-b1cb-560c25d05c98 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.705719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1847-5cb2-4238-b1cb-560c25d05c98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.711043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f1be5-461d-425b-bea4-926bd8ecc763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:27.712035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1be5-461d-425b-bea4-926bd8ecc763 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.712558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1be5-461d-425b-bea4-926bd8ecc763 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.712902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f1be5-461d-425b-bea4-926bd8ecc763 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.713876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f1be5-461d-425b-bea4-926bd8ecc763 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:27.714266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f1be5-461d-425b-bea4-926bd8ecc763 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:27.716054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f1be5-461d-425b-bea4-926bd8ecc763 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:27.717222 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c1847-5cb2-4238-b1cb-560c25d05c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-324c1847-5cb2-4238-b1cb-560c25d05c98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:27.722887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:27.723812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:27.724595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 247/492] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:27.725260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa000f-f746-424b-b76a-720b12310fb3 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.726060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa000f-f746-424b-b76a-720b12310fb3 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.726060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa000f-f746-424b-b76a-720b12310fb3 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.732393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 248/493] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:27.734002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa000f-f746-424b-b76a-720b12310fb3 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:27.763134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 246/494] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 19:40:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:27.764479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aae26f-a9f4-4c25-9b84-fcefa179895b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.764766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aae26f-a9f4-4c25-9b84-fcefa179895b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.765037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aae26f-a9f4-4c25-9b84-fcefa179895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.782738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-94aae26f-a9f4-4c25-9b84-fcefa179895b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:27.783956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-94aae26f-a9f4-4c25-9b84-fcefa179895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:27.846364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa000f-f746-424b-b76a-720b12310fb3 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:27.851114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 247/495] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:27.852376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6bb90-f436-4d68-a0a4-0ffa99028555 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.852658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6bb90-f436-4d68-a0a4-0ffa99028555 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.852968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6bb90-f436-4d68-a0a4-0ffa99028555 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.855301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 248/496] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:27.855301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6bb90-f436-4d68-a0a4-0ffa99028555 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:27.887633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13760e22-af94-4e1b-bdbf-b9713a6716c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:27.888555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13760e22-af94-4e1b-bdbf-b9713a6716c0 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:27.889031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13760e22-af94-4e1b-bdbf-b9713a6716c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:27.889526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13760e22-af94-4e1b-bdbf-b9713a6716c0 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:27.890811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13760e22-af94-4e1b-bdbf-b9713a6716c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:27.891562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13760e22-af94-4e1b-bdbf-b9713a6716c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:27.894177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13760e22-af94-4e1b-bdbf-b9713a6716c0 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:27.905727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 249/497] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:27.906821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13760e22-af94-4e1b-bdbf-b9713a6716c0 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:27.915482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:27.977567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6bb90-f436-4d68-a0a4-0ffa99028555 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:27.987146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:28.015255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88527d0-5a25-41bf-9ae2-6bcc3b1b6c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.015845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88527d0-5a25-41bf-9ae2-6bcc3b1b6c80 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.016418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88527d0-5a25-41bf-9ae2-6bcc3b1b6c80 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.016736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88527d0-5a25-41bf-9ae2-6bcc3b1b6c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.029987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13760e22-af94-4e1b-bdbf-b9713a6716c0 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.069937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c716c2-dab9-4571-8f40-569c0603beed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.071000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c716c2-dab9-4571-8f40-569c0603beed None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.071000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c716c2-dab9-4571-8f40-569c0603beed None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.071327 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c716c2-dab9-4571-8f40-569c0603beed None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.083149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c716c2-dab9-4571-8f40-569c0603beed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:28.086562 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88527d0-5a25-41bf-9ae2-6bcc3b1b6c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:28.088076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88527d0-5a25-41bf-9ae2-6bcc3b1b6c80 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-59c716c2-dab9-4571-8f40-569c0603beed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:28.088534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:28.089413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:28.090284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 250/498] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:28.091416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ffa56-1977-49b1-acb7-41b320852d54 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.091742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ffa56-1977-49b1-acb7-41b320852d54 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.091905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ffa56-1977-49b1-acb7-41b320852d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.110469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-852ffa56-1977-49b1-acb7-41b320852d54 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:28.111676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-852ffa56-1977-49b1-acb7-41b320852d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:28.175802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:28.184752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 251/499] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:28.188957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ffa56-1977-49b1-acb7-41b320852d54 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.200782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 249/500] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:28.201628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88527d0-5a25-41bf-9ae2-6bcc3b1b6c80 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.212563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:28.292853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ffa56-1977-49b1-acb7-41b320852d54 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.309001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88527d0-5a25-41bf-9ae2-6bcc3b1b6c80 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.327048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d5301-717a-4c50-a6ea-c6fef12a078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.327700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d5301-717a-4c50-a6ea-c6fef12a078a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.327979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d5301-717a-4c50-a6ea-c6fef12a078a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.328242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d5301-717a-4c50-a6ea-c6fef12a078a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.338750 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d5301-717a-4c50-a6ea-c6fef12a078a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:28.340236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d5301-717a-4c50-a6ea-c6fef12a078a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:28.346576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97c8f-ea10-4018-a8b2-ced52da346cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.348217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97c8f-ea10-4018-a8b2-ced52da346cb None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.348494 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97c8f-ea10-4018-a8b2-ced52da346cb None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.348837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97c8f-ea10-4018-a8b2-ced52da346cb None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.349912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae97c8f-ea10-4018-a8b2-ced52da346cb None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:28.350386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae97c8f-ea10-4018-a8b2-ced52da346cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:28.351803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae97c8f-ea10-4018-a8b2-ced52da346cb None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-051d5301-717a-4c50-a6ea-c6fef12a078a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:28.355288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:28.356172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:28.357007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:28.357007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:28.357007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:28.357007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 252/501] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:28.357646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d5301-717a-4c50-a6ea-c6fef12a078a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.369989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 250/502] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:28.369989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97c8f-ea10-4018-a8b2-ced52da346cb None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.410197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:28.451573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:28.466259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d5301-717a-4c50-a6ea-c6fef12a078a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.484655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97c8f-ea10-4018-a8b2-ced52da346cb None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.501110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e374-13de-452d-8256-f6cb7a4a2cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.501727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e374-13de-452d-8256-f6cb7a4a2cd7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.502002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e374-13de-452d-8256-f6cb7a4a2cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.502268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e374-13de-452d-8256-f6cb7a4a2cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.513008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e374-13de-452d-8256-f6cb7a4a2cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:28.514455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e374-13de-452d-8256-f6cb7a4a2cd7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:28.518194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67df7d0-2ac8-4736-9391-7b4dcf0eb17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.518930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67df7d0-2ac8-4736-9391-7b4dcf0eb17a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.519208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67df7d0-2ac8-4736-9391-7b4dcf0eb17a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.519503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67df7d0-2ac8-4736-9391-7b4dcf0eb17a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-8124e374-13de-452d-8256-f6cb7a4a2cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:28.529278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:28.530148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:28.530981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:28.530981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:28.530981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:28.531158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67df7d0-2ac8-4736-9391-7b4dcf0eb17a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:28.531253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 253/503] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:28.531253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e374-13de-452d-8256-f6cb7a4a2cd7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.531913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67df7d0-2ac8-4736-9391-7b4dcf0eb17a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-a67df7d0-2ac8-4736-9391-7b4dcf0eb17a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:28.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:28.549347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:28.550866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:28.550866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:28.550866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:28.550866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 251/504] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:28.551078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67df7d0-2ac8-4736-9391-7b4dcf0eb17a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.633408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:28.636956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e374-13de-452d-8256-f6cb7a4a2cd7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.653607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67df7d0-2ac8-4736-9391-7b4dcf0eb17a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.671953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff33205-aa41-4553-a070-1889669a8855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.672570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff33205-aa41-4553-a070-1889669a8855 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.673183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff33205-aa41-4553-a070-1889669a8855 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.673461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff33205-aa41-4553-a070-1889669a8855 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.674115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff33205-aa41-4553-a070-1889669a8855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:28.674420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff33205-aa41-4553-a070-1889669a8855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:28.675947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff33205-aa41-4553-a070-1889669a8855 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:28.676230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:28.687214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746e74-1eb9-4dc0-9f97-ec8a7e2c8f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.692073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 254/505] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:28.692213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746e74-1eb9-4dc0-9f97-ec8a7e2c8f91 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.692213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746e74-1eb9-4dc0-9f97-ec8a7e2c8f91 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.692342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff33205-aa41-4553-a070-1889669a8855 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.692434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746e74-1eb9-4dc0-9f97-ec8a7e2c8f91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.699183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746e74-1eb9-4dc0-9f97-ec8a7e2c8f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:28.700793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12746e74-1eb9-4dc0-9f97-ec8a7e2c8f91 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-12746e74-1eb9-4dc0-9f97-ec8a7e2c8f91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:28.715966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:28.717011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:28.718183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:28.718183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:28.718183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:28.718183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 252/506] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:28.718183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746e74-1eb9-4dc0-9f97-ec8a7e2c8f91 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.791065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff33205-aa41-4553-a070-1889669a8855 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.821749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12746e74-1eb9-4dc0-9f97-ec8a7e2c8f91 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.825596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269142ad-e101-4ca7-8eb5-7e9128dd46bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.826219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269142ad-e101-4ca7-8eb5-7e9128dd46bf None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.826499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269142ad-e101-4ca7-8eb5-7e9128dd46bf None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.826771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269142ad-e101-4ca7-8eb5-7e9128dd46bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.838266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269142ad-e101-4ca7-8eb5-7e9128dd46bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-269142ad-e101-4ca7-8eb5-7e9128dd46bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:28.844359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:28.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:28.846093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 255/507] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:28.846830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269142ad-e101-4ca7-8eb5-7e9128dd46bf None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.859380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91007b-b998-454e-9123-6d1ca3044a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.859984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91007b-b998-454e-9123-6d1ca3044a62 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.860507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91007b-b998-454e-9123-6d1ca3044a62 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.860507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91007b-b998-454e-9123-6d1ca3044a62 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.861159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91007b-b998-454e-9123-6d1ca3044a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:28.861455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91007b-b998-454e-9123-6d1ca3044a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:28.863382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91007b-b998-454e-9123-6d1ca3044a62 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:28.867954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:28.875072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 253/508] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:28.875902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91007b-b998-454e-9123-6d1ca3044a62 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:28.910025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:28.953093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269142ad-e101-4ca7-8eb5-7e9128dd46bf None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.978541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91007b-b998-454e-9123-6d1ca3044a62 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:28.985984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8d06b-7fdc-4d5e-b52c-30d24889e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:28.986597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8d06b-7fdc-4d5e-b52c-30d24889e887 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:28.986874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8d06b-7fdc-4d5e-b52c-30d24889e887 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:28.987178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8d06b-7fdc-4d5e-b52c-30d24889e887 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:28.988441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8d06b-7fdc-4d5e-b52c-30d24889e887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:28.988749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8d06b-7fdc-4d5e-b52c-30d24889e887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:28.990137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8d06b-7fdc-4d5e-b52c-30d24889e887 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.002430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 256/509] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:29.003932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8d06b-7fdc-4d5e-b52c-30d24889e887 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.019326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eea1f-8585-44ba-965f-2f623a2c654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.019711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eea1f-8585-44ba-965f-2f623a2c654c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.019994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eea1f-8585-44ba-965f-2f623a2c654c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.020245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eea1f-8585-44ba-965f-2f623a2c654c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.027582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eea1f-8585-44ba-965f-2f623a2c654c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.029027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eea1f-8585-44ba-965f-2f623a2c654c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-087eea1f-8585-44ba-965f-2f623a2c654c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:29.040736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:29.041695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 254/510] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:29.042600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eea1f-8585-44ba-965f-2f623a2c654c None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.085944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:29.106999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8d06b-7fdc-4d5e-b52c-30d24889e887 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.142335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128db20-04dd-4cbc-bb44-74b2cc60a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.143000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128db20-04dd-4cbc-bb44-74b2cc60a73b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.143314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128db20-04dd-4cbc-bb44-74b2cc60a73b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.143622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128db20-04dd-4cbc-bb44-74b2cc60a73b None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.145002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128db20-04dd-4cbc-bb44-74b2cc60a73b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:29.145312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128db20-04dd-4cbc-bb44-74b2cc60a73b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.146685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128db20-04dd-4cbc-bb44-74b2cc60a73b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.147809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:29.154517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eea1f-8585-44ba-965f-2f623a2c654c None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.157908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 257/511] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:29.158687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128db20-04dd-4cbc-bb44-74b2cc60a73b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.188412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d83d0-360b-4eef-a3f9-f28b9bd067eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.189018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d83d0-360b-4eef-a3f9-f28b9bd067eb None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.189296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d83d0-360b-4eef-a3f9-f28b9bd067eb None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.189566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d83d0-360b-4eef-a3f9-f28b9bd067eb None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.190233 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d83d0-360b-4eef-a3f9-f28b9bd067eb None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:29.191094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d83d0-360b-4eef-a3f9-f28b9bd067eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.192624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d83d0-360b-4eef-a3f9-f28b9bd067eb None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.200806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 255/512] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:29.201674 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d83d0-360b-4eef-a3f9-f28b9bd067eb None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.264574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128db20-04dd-4cbc-bb44-74b2cc60a73b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.297927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d0d7f-71dd-42c2-9294-91eb4eacd5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.298538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d0d7f-71dd-42c2-9294-91eb4eacd5d5 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.298816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d0d7f-71dd-42c2-9294-91eb4eacd5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.299084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d0d7f-71dd-42c2-9294-91eb4eacd5d5 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.299626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d83d0-360b-4eef-a3f9-f28b9bd067eb None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.299755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d0d7f-71dd-42c2-9294-91eb4eacd5d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.301375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d0d7f-71dd-42c2-9294-91eb4eacd5d5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.311664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:29.334846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a972e-41aa-4387-931f-faea09698c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.335502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a972e-41aa-4387-931f-faea09698c01 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.335788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a972e-41aa-4387-931f-faea09698c01 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.336057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a972e-41aa-4387-931f-faea09698c01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.342703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a972e-41aa-4387-931f-faea09698c01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.344160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a972e-41aa-4387-931f-faea09698c01 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-dd7a972e-41aa-4387-931f-faea09698c01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:29.356100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:29.356959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:29.357848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:29.357848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:29.357848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:29.357848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:29.357848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:29.357848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:29.357848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:29.357848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:29.357848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 256/513] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:29.358319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a972e-41aa-4387-931f-faea09698c01 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.375669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:29.428925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 258/514] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:40:29 2022] POST /identity/v3/users => generated 247 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:40:29.429781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d0d7f-71dd-42c2-9294-91eb4eacd5d5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.466388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a972e-41aa-4387-931f-faea09698c01 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.510504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b246d36-248a-407e-9a09-fda045858317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.511430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b246d36-248a-407e-9a09-fda045858317 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.511772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b246d36-248a-407e-9a09-fda045858317 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.512183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b246d36-248a-407e-9a09-fda045858317 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.512901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b246d36-248a-407e-9a09-fda045858317 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:29.513201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b246d36-248a-407e-9a09-fda045858317 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.514731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b246d36-248a-407e-9a09-fda045858317 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.540178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 257/515] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:29.540178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b246d36-248a-407e-9a09-fda045858317 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.548786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d0d7f-71dd-42c2-9294-91eb4eacd5d5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.587168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e38a6-4bed-48a9-b26b-dcb77346bf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.587835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e38a6-4bed-48a9-b26b-dcb77346bf22 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.588503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e38a6-4bed-48a9-b26b-dcb77346bf22 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.588503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e38a6-4bed-48a9-b26b-dcb77346bf22 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.598278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e38a6-4bed-48a9-b26b-dcb77346bf22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.600527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e38a6-4bed-48a9-b26b-dcb77346bf22 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-e99e38a6-4bed-48a9-b26b-dcb77346bf22 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:29.615546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:29.616507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:29.617387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 259/516] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:29.617940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e38a6-4bed-48a9-b26b-dcb77346bf22 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.633908 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:29.662097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b246d36-248a-407e-9a09-fda045858317 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.680966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:29.700358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10358fcc-c613-4635-8e68-0979a2a9f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.700998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10358fcc-c613-4635-8e68-0979a2a9f9dd None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.701329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10358fcc-c613-4635-8e68-0979a2a9f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.701642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10358fcc-c613-4635-8e68-0979a2a9f9dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.713991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10358fcc-c613-4635-8e68-0979a2a9f9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.715834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10358fcc-c613-4635-8e68-0979a2a9f9dd None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.729782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e38a6-4bed-48a9-b26b-dcb77346bf22 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-10358fcc-c613-4635-8e68-0979a2a9f9dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:29.732293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:29.733184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:29.734036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:29.734036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:29.734036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:29.734755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 258/517] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:29.735794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10358fcc-c613-4635-8e68-0979a2a9f9dd None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.770378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c52d-99e3-4080-8a25-e99242efdda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.771167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c52d-99e3-4080-8a25-e99242efdda1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.771469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c52d-99e3-4080-8a25-e99242efdda1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.771739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3c52d-99e3-4080-8a25-e99242efdda1 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.772437 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c52d-99e3-4080-8a25-e99242efdda1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:29.772890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c52d-99e3-4080-8a25-e99242efdda1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.775127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3c52d-99e3-4080-8a25-e99242efdda1 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.799275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 260/518] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:29.799275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c52d-99e3-4080-8a25-e99242efdda1 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:29.848249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10358fcc-c613-4635-8e68-0979a2a9f9dd None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.874091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:29.883297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e952cb-d355-4149-8558-b055dadf6522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.883909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e952cb-d355-4149-8558-b055dadf6522 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.884186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e952cb-d355-4149-8558-b055dadf6522 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.886410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e952cb-d355-4149-8558-b055dadf6522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.910459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3c52d-99e3-4080-8a25-e99242efdda1 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:29.926355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:29.945926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1d019-df1b-4678-b520-4148b12e2778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:29.946564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1d019-df1b-4678-b520-4148b12e2778 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:29.949239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1d019-df1b-4678-b520-4148b12e2778 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:29.949239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1d019-df1b-4678-b520-4148b12e2778 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:29.949239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1d019-df1b-4678-b520-4148b12e2778 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:29.949239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1d019-df1b-4678-b520-4148b12e2778 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.949569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1d019-df1b-4678-b520-4148b12e2778 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.958443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e952cb-d355-4149-8558-b055dadf6522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:29.959925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e952cb-d355-4149-8558-b055dadf6522 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:29.990262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 261/519] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:29.991513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1d019-df1b-4678-b520-4148b12e2778 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.075546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 259/520] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:30.076221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e952cb-d355-4149-8558-b055dadf6522 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.105473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:30.106427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1d019-df1b-4678-b520-4148b12e2778 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:30.145001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397f78-c25e-4582-8b2d-8709e24880f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:30.145608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397f78-c25e-4582-8b2d-8709e24880f1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:30.145885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397f78-c25e-4582-8b2d-8709e24880f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:30.146325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397f78-c25e-4582-8b2d-8709e24880f1 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:30.146981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397f78-c25e-4582-8b2d-8709e24880f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:30.147804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397f78-c25e-4582-8b2d-8709e24880f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:30.149483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397f78-c25e-4582-8b2d-8709e24880f1 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:30.162618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 262/521] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:30.163704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397f78-c25e-4582-8b2d-8709e24880f1 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.187810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e952cb-d355-4149-8558-b055dadf6522 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:30.202141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:30.227567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a3a67-0005-4dbb-8225-15f28c8f6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:30.228170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a3a67-0005-4dbb-8225-15f28c8f6f65 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:30.228454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a3a67-0005-4dbb-8225-15f28c8f6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:30.228727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a3a67-0005-4dbb-8225-15f28c8f6f65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:30.229481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a3a67-0005-4dbb-8225-15f28c8f6f65 None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1787fcb6f7c34de59c9682a4d8c3d2a3) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:30.229847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a3a67-0005-4dbb-8225-15f28c8f6f65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:30.231368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a3a67-0005-4dbb-8225-15f28c8f6f65 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:30.247262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 260/522] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:30 2022] GET /identity/v3/role_assignments?user.id=1787fcb6f7c34de59c9682a4d8c3d2a3&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:30.247262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a3a67-0005-4dbb-8225-15f28c8f6f65 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.293237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397f78-c25e-4582-8b2d-8709e24880f1 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:30.350005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8424-e6bf-412a-bb7f-b7320d0419e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:30.351070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8424-e6bf-412a-bb7f-b7320d0419e7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:30.351530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8424-e6bf-412a-bb7f-b7320d0419e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:30.351883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d8424-e6bf-412a-bb7f-b7320d0419e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:30.357341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:30.368644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a3a67-0005-4dbb-8225-15f28c8f6f65 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:30.420753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838833a-620e-4286-96c6-e706399eda2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:30.421683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838833a-620e-4286-96c6-e706399eda2f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:30.421925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838833a-620e-4286-96c6-e706399eda2f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:30.422293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838833a-620e-4286-96c6-e706399eda2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:30.434654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838833a-620e-4286-96c6-e706399eda2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:30.436309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838833a-620e-4286-96c6-e706399eda2f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:30.449711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8424-e6bf-412a-bb7f-b7320d0419e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:30.451429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d8424-e6bf-412a-bb7f-b7320d0419e7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-1838833a-620e-4286-96c6-e706399eda2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:30.458301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:30.459443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:30.460342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:30.460342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:30.460342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:30.465869 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 261/523] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:30.466763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838833a-620e-4286-96c6-e706399eda2f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.492358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:30.575186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 263/524] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:30.576643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8424-e6bf-412a-bb7f-b7320d0419e7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.594840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838833a-620e-4286-96c6-e706399eda2f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:30.631297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe9cdd-f655-49b4-bd31-07c4dbe5f465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:30.631718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe9cdd-f655-49b4-bd31-07c4dbe5f465 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:30.631996 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe9cdd-f655-49b4-bd31-07c4dbe5f465 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:30.632275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe9cdd-f655-49b4-bd31-07c4dbe5f465 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:30.640312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe9cdd-f655-49b4-bd31-07c4dbe5f465 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:30.641776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe9cdd-f655-49b4-bd31-07c4dbe5f465 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-99fe9cdd-f655-49b4-bd31-07c4dbe5f465 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:30.654146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:30.655082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 19:40:30.656010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:30.660331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 262/525] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:30.661193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe9cdd-f655-49b4-bd31-07c4dbe5f465 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.664112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:30.696483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d8424-e6bf-412a-bb7f-b7320d0419e7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:30.732253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:30.738659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b47a5-d8b9-4726-aba4-cbe932d877b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:30.739604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b47a5-d8b9-4726-aba4-cbe932d877b2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:30.740110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b47a5-d8b9-4726-aba4-cbe932d877b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:30.740588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b47a5-d8b9-4726-aba4-cbe932d877b2 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:30.741582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b47a5-d8b9-4726-aba4-cbe932d877b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:30.742077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b47a5-d8b9-4726-aba4-cbe932d877b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:30.743753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b47a5-d8b9-4726-aba4-cbe932d877b2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:30.757643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 264/526] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:30.758641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b47a5-d8b9-4726-aba4-cbe932d877b2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.772773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe9cdd-f655-49b4-bd31-07c4dbe5f465 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:30.809146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b485-ac55-46d3-ac87-199339bf7ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:30.809779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b485-ac55-46d3-ac87-199339bf7ff6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:30.810057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b485-ac55-46d3-ac87-199339bf7ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:30.810332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2b485-ac55-46d3-ac87-199339bf7ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:30.822160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b485-ac55-46d3-ac87-199339bf7ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:30.823687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2b485-ac55-46d3-ac87-199339bf7ff6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-44e2b485-ac55-46d3-ac87-199339bf7ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:30.838850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:30.839984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:30.841018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:30.841018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:30.841018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:30.843608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 263/527] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:30.844441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b485-ac55-46d3-ac87-199339bf7ff6 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.876125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b47a5-d8b9-4726-aba4-cbe932d877b2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:30.905121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:30.917320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f439dd-7f14-434d-9aac-a517e1fda909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:30.918262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f439dd-7f14-434d-9aac-a517e1fda909 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:30.918670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f439dd-7f14-434d-9aac-a517e1fda909 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:30.919043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f439dd-7f14-434d-9aac-a517e1fda909 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:30.920042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f439dd-7f14-434d-9aac-a517e1fda909 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:30.920468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f439dd-7f14-434d-9aac-a517e1fda909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:30.922012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f439dd-7f14-434d-9aac-a517e1fda909 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:30.941953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 265/528] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Aug 22 19:40:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:30.942941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f439dd-7f14-434d-9aac-a517e1fda909 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:30.960008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2b485-ac55-46d3-ac87-199339bf7ff6 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:30.996098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fc47d-de94-425e-a4cd-b38ddc7fe4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:30.996729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fc47d-de94-425e-a4cd-b38ddc7fe4e0 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:30.997010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fc47d-de94-425e-a4cd-b38ddc7fe4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:30.997285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fc47d-de94-425e-a4cd-b38ddc7fe4e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.002586 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:31.004573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fc47d-de94-425e-a4cd-b38ddc7fe4e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:31.006411 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fc47d-de94-425e-a4cd-b38ddc7fe4e0 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-812fc47d-de94-425e-a4cd-b38ddc7fe4e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:31.018302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:31.020749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:31.022518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:31.022518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:31.022518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:31.022518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:31.022518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:31.022518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:31.022518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:31.022518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:31.030206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 264/529] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:31.030206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fc47d-de94-425e-a4cd-b38ddc7fe4e0 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:31.062722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f439dd-7f14-434d-9aac-a517e1fda909 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:31.103727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30c9c1-2356-4400-a435-c3160e3a8b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:31.104405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c9c1-2356-4400-a435-c3160e3a8b49 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:31.104686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c9c1-2356-4400-a435-c3160e3a8b49 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:31.104960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c9c1-2356-4400-a435-c3160e3a8b49 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.105623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30c9c1-2356-4400-a435-c3160e3a8b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:31.105925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30c9c1-2356-4400-a435-c3160e3a8b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:31.107452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30c9c1-2356-4400-a435-c3160e3a8b49 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:31.124469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 266/530] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:31.124469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30c9c1-2356-4400-a435-c3160e3a8b49 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:31.144738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fc47d-de94-425e-a4cd-b38ddc7fe4e0 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:31.160280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:31.181689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674914-c518-4f49-94df-3bf82b8fe355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:31.182312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674914-c518-4f49-94df-3bf82b8fe355 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:31.182589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674914-c518-4f49-94df-3bf82b8fe355 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:31.182860 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674914-c518-4f49-94df-3bf82b8fe355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.242121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30c9c1-2356-4400-a435-c3160e3a8b49 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:31.261011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:31.264606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69674914-c518-4f49-94df-3bf82b8fe355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:31.267211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69674914-c518-4f49-94df-3bf82b8fe355 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:31.283375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1438b1-d5f2-4827-9b01-9922d4d8ae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:31.285220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1438b1-d5f2-4827-9b01-9922d4d8ae1d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:31.285486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1438b1-d5f2-4827-9b01-9922d4d8ae1d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:31.285956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1438b1-d5f2-4827-9b01-9922d4d8ae1d None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.287439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1438b1-d5f2-4827-9b01-9922d4d8ae1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:31.287439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1438b1-d5f2-4827-9b01-9922d4d8ae1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:31.289158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1438b1-d5f2-4827-9b01-9922d4d8ae1d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:31.307762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 267/531] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:31.308720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1438b1-d5f2-4827-9b01-9922d4d8ae1d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:31.426091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 265/532] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:31.427406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674914-c518-4f49-94df-3bf82b8fe355 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:31.447671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:31.451818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1438b1-d5f2-4827-9b01-9922d4d8ae1d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:31.489178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ed9c1-1c35-494b-950d-c39033985f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:31.489808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ed9c1-1c35-494b-950d-c39033985f24 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:31.490088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ed9c1-1c35-494b-950d-c39033985f24 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:31.490358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ed9c1-1c35-494b-950d-c39033985f24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.499735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ed9c1-1c35-494b-950d-c39033985f24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:31.501180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ed9c1-1c35-494b-950d-c39033985f24 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-323ed9c1-1c35-494b-950d-c39033985f24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:31.513759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:31.514605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:31.515472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:31.515472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:31.515472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:31.515472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:31.515472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:31.515472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:31.515472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:31.515472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:31.515472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 268/533] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:31.515951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ed9c1-1c35-494b-950d-c39033985f24 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:31.547482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674914-c518-4f49-94df-3bf82b8fe355 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:31.552085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:31.584505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca152ac4-d45f-4eb7-abea-5f38fdd6577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:31.585105 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca152ac4-d45f-4eb7-abea-5f38fdd6577a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:31.585382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca152ac4-d45f-4eb7-abea-5f38fdd6577a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:31.585652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca152ac4-d45f-4eb7-abea-5f38fdd6577a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.586379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca152ac4-d45f-4eb7-abea-5f38fdd6577a None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=2422c781c74f44ae83e8b094f1728743) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:31.586686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca152ac4-d45f-4eb7-abea-5f38fdd6577a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:31.588143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca152ac4-d45f-4eb7-abea-5f38fdd6577a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:31.593836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 266/534] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:31 2022] GET /identity/v3/role_assignments?user.id=2422c781c74f44ae83e8b094f1728743&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:31.594807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae053-ab1b-48c3-b026-d44ee5e3b617 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:31.595086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae053-ab1b-48c3-b026-d44ee5e3b617 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:31.595388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae053-ab1b-48c3-b026-d44ee5e3b617 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.600854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 267/535] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:31.600854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae053-ab1b-48c3-b026-d44ee5e3b617 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:31.656239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ed9c1-1c35-494b-950d-c39033985f24 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:31.703681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:31.710331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b47e-e48c-4f4a-855d-bc3f2488ca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:31.711430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b47e-e48c-4f4a-855d-bc3f2488ca92 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:31.712211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b47e-e48c-4f4a-855d-bc3f2488ca92 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:31.713061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b47e-e48c-4f4a-855d-bc3f2488ca92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.728861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b47e-e48c-4f4a-855d-bc3f2488ca92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:31.732117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae053-ab1b-48c3-b026-d44ee5e3b617 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:31.732243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b47e-e48c-4f4a-855d-bc3f2488ca92 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-adf5b47e-e48c-4f4a-855d-bc3f2488ca92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:31.751248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:31.752180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:31.754007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:31.754007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:31.754007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:31.756003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 269/536] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:31.757349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cd318-05c0-4c31-858d-19e3b6f3cffb None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:31.757850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cd318-05c0-4c31-858d-19e3b6f3cffb None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:31.758268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cd318-05c0-4c31-858d-19e3b6f3cffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.776288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fa6ba-cb4c-4945-b35e-927d36c7c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:31.777249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fa6ba-cb4c-4945-b35e-927d36c7c4bc None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:31.777729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fa6ba-cb4c-4945-b35e-927d36c7c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:31.778232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fa6ba-cb4c-4945-b35e-927d36c7c4bc None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:31.779189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fa6ba-cb4c-4945-b35e-927d36c7c4bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:31.779703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fa6ba-cb4c-4945-b35e-927d36c7c4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:31.781345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-cd4cd318-05c0-4c31-858d-19e3b6f3cffb None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:31.781666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fa6ba-cb4c-4945-b35e-927d36c7c4bc None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:31.782667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cd4cd318-05c0-4c31-858d-19e3b6f3cffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:31.807110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 268/537] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:31.808367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fa6ba-cb4c-4945-b35e-927d36c7c4bc None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:31.860484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 270/538] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:31.861612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cd318-05c0-4c31-858d-19e3b6f3cffb None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:31.889114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:31.976424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fa6ba-cb4c-4945-b35e-927d36c7c4bc None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:32.030007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cd318-05c0-4c31-858d-19e3b6f3cffb None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:32.038756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a593f59-bb3c-4869-b5c2-22b4c931dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:32.039445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a593f59-bb3c-4869-b5c2-22b4c931dd74 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:32.039794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a593f59-bb3c-4869-b5c2-22b4c931dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:32.040074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a593f59-bb3c-4869-b5c2-22b4c931dd74 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:32.041074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a593f59-bb3c-4869-b5c2-22b4c931dd74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:32.041185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a593f59-bb3c-4869-b5c2-22b4c931dd74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:32.042525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a593f59-bb3c-4869-b5c2-22b4c931dd74 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:32.053673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:32.064840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 269/539] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:32.066641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a593f59-bb3c-4869-b5c2-22b4c931dd74 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:32.105126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008ebd-5cec-471b-bcb9-a4c3ea86fe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:32.106088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008ebd-5cec-471b-bcb9-a4c3ea86fe3b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:32.106687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008ebd-5cec-471b-bcb9-a4c3ea86fe3b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:32.107153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008ebd-5cec-471b-bcb9-a4c3ea86fe3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:32.108161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008ebd-5cec-471b-bcb9-a4c3ea86fe3b None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=4414630bb2da4523906f0b2dee0c4c4f) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:32.109115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008ebd-5cec-471b-bcb9-a4c3ea86fe3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:32.111000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008ebd-5cec-471b-bcb9-a4c3ea86fe3b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:32.129417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 271/540] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:31 2022] GET /identity/v3/role_assignments?user.id=4414630bb2da4523906f0b2dee0c4c4f&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:32.190188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a593f59-bb3c-4869-b5c2-22b4c931dd74 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:32.220495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008ebd-5cec-471b-bcb9-a4c3ea86fe3b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:32.226834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17871991-78e7-4835-b327-e761233faae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:32.227429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17871991-78e7-4835-b327-e761233faae2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:32.227704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17871991-78e7-4835-b327-e761233faae2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:32.227966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17871991-78e7-4835-b327-e761233faae2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:32.236750 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17871991-78e7-4835-b327-e761233faae2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:32.238875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17871991-78e7-4835-b327-e761233faae2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-17871991-78e7-4835-b327-e761233faae2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:32.252115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:32.253099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:32.254034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:32.254034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:32.254034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:32.254034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:32.254034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:32.254034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:32.254034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:32.254034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:32.259074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 270/541] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:32.260639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17871991-78e7-4835-b327-e761233faae2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:32.336975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:32.369489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:32.395637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008ebd-5cec-471b-bcb9-a4c3ea86fe3b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:32.441257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0f70f-5687-4a6f-8e1f-8355dab52847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:32.442006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0f70f-5687-4a6f-8e1f-8355dab52847 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:32.442282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0f70f-5687-4a6f-8e1f-8355dab52847 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:32.442928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0f70f-5687-4a6f-8e1f-8355dab52847 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:32.456817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17871991-78e7-4835-b327-e761233faae2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:32.457555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0f70f-5687-4a6f-8e1f-8355dab52847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-28a0f70f-5687-4a6f-8e1f-8355dab52847 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:32.464189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:32.465270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:32.466237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 272/542] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:32.467002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e2484-3d10-42af-899b-6c092118d048 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:32.467068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e2484-3d10-42af-899b-6c092118d048 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:32.471246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e2484-3d10-42af-899b-6c092118d048 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:32.471246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 273/543] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:32.477421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e7c5-73b0-402b-a9c6-ee22a8ef8d4d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:32.477678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e7c5-73b0-402b-a9c6-ee22a8ef8d4d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:32.477902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72e7c5-73b0-402b-a9c6-ee22a8ef8d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:32.501963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ed72e7c5-73b0-402b-a9c6-ee22a8ef8d4d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:32.504680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ed72e7c5-73b0-402b-a9c6-ee22a8ef8d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:32.519555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ec128-1b4e-4556-8431-6173547f47c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:32.521076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec128-1b4e-4556-8431-6173547f47c6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:32.521577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec128-1b4e-4556-8431-6173547f47c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:32.522482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ec128-1b4e-4556-8431-6173547f47c6 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:32.523744 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ec128-1b4e-4556-8431-6173547f47c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:32.524261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ec128-1b4e-4556-8431-6173547f47c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:32.527194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ec128-1b4e-4556-8431-6173547f47c6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:32.548208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 271/544] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:32.549088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ec128-1b4e-4556-8431-6173547f47c6 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:32.618941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 274/545] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:32.618941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e7c5-73b0-402b-a9c6-ee22a8ef8d4d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:32.707017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ec128-1b4e-4556-8431-6173547f47c6 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:32.744766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:32.750674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:32.767438 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dadf7-7ec1-4001-9d1a-bdf6e29261e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:32.768082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dadf7-7ec1-4001-9d1a-bdf6e29261e2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:32.768361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dadf7-7ec1-4001-9d1a-bdf6e29261e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:32.768696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dadf7-7ec1-4001-9d1a-bdf6e29261e2 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:32.769406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dadf7-7ec1-4001-9d1a-bdf6e29261e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:32.769712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dadf7-7ec1-4001-9d1a-bdf6e29261e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:32.771162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dadf7-7ec1-4001-9d1a-bdf6e29261e2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:32.799722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 272/546] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:32.808718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dadf7-7ec1-4001-9d1a-bdf6e29261e2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:32.827676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72e7c5-73b0-402b-a9c6-ee22a8ef8d4d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:32.867174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ecaf4-161b-4ac3-bad0-230c3cf0fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:32.868209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ecaf4-161b-4ac3-bad0-230c3cf0fb21 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:32.868692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ecaf4-161b-4ac3-bad0-230c3cf0fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:32.869181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ecaf4-161b-4ac3-bad0-230c3cf0fb21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:32.870123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ecaf4-161b-4ac3-bad0-230c3cf0fb21 None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=7500529eff574ca6ae3a9a77d72d2a40) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:32.870649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ecaf4-161b-4ac3-bad0-230c3cf0fb21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:32.872362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ecaf4-161b-4ac3-bad0-230c3cf0fb21 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:32.880418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 275/547] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:32 2022] GET /identity/v3/role_assignments?user.id=7500529eff574ca6ae3a9a77d72d2a40&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:32.990706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ecaf4-161b-4ac3-bad0-230c3cf0fb21 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:33.055714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dadf7-7ec1-4001-9d1a-bdf6e29261e2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:33.114617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0206c0-0890-4fe0-9113-44782705e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:33.115320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0206c0-0890-4fe0-9113-44782705e60a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:33.115606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0206c0-0890-4fe0-9113-44782705e60a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:33.116132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0206c0-0890-4fe0-9113-44782705e60a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:33.129661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0206c0-0890-4fe0-9113-44782705e60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:33.131526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0206c0-0890-4fe0-9113-44782705e60a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:33.134905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ecaf4-161b-4ac3-bad0-230c3cf0fb21 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-9e0206c0-0890-4fe0-9113-44782705e60a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:33.149725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:33.150810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:33.152050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:33.152050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:33.152050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:33.152050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 273/548] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:33.164298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0206c0-0890-4fe0-9113-44782705e60a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:33.176912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:33.184251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52e9f-5d65-41b0-9767-59ae85fb567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:33.189363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52e9f-5d65-41b0-9767-59ae85fb567b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:33.189363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52e9f-5d65-41b0-9767-59ae85fb567b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:33.189363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52e9f-5d65-41b0-9767-59ae85fb567b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:33.209789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d52e9f-5d65-41b0-9767-59ae85fb567b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-e9d52e9f-5d65-41b0-9767-59ae85fb567b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:33.216781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:33.217920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:33.218731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:33.225072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 276/549] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:33.229433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52e9f-5d65-41b0-9767-59ae85fb567b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:33.229979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:33.361547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0206c0-0890-4fe0-9113-44782705e60a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:33.432135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52e9f-5d65-41b0-9767-59ae85fb567b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:33.471034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336e451-46f9-4b79-a4ed-fc7ccb19c46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:33.472382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336e451-46f9-4b79-a4ed-fc7ccb19c46a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:33.473097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336e451-46f9-4b79-a4ed-fc7ccb19c46a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:33.473596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336e451-46f9-4b79-a4ed-fc7ccb19c46a None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:33.474579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336e451-46f9-4b79-a4ed-fc7ccb19c46a None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:33.475074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336e451-46f9-4b79-a4ed-fc7ccb19c46a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:33.476861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336e451-46f9-4b79-a4ed-fc7ccb19c46a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:33.486859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 277/550] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:33.492670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336e451-46f9-4b79-a4ed-fc7ccb19c46a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:33.497135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6295-6795-45cc-b908-0577429c83f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:33.499637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6295-6795-45cc-b908-0577429c83f2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:33.500109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6295-6795-45cc-b908-0577429c83f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:33.502328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6295-6795-45cc-b908-0577429c83f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:33.504191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6295-6795-45cc-b908-0577429c83f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:33.504824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6295-6795-45cc-b908-0577429c83f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:33.506816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6295-6795-45cc-b908-0577429c83f2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:33.531292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 274/551] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:33.540996 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6295-6795-45cc-b908-0577429c83f2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:33.597231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:33.660211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:33.665606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6295-6795-45cc-b908-0577429c83f2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:33.686089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336e451-46f9-4b79-a4ed-fc7ccb19c46a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:33.705599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c5097-81b2-4f4c-8008-fb4abcc75c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:33.707199 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5097-81b2-4f4c-8008-fb4abcc75c80 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:33.707708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5097-81b2-4f4c-8008-fb4abcc75c80 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:33.708141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c5097-81b2-4f4c-8008-fb4abcc75c80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:33.724650 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c5097-81b2-4f4c-8008-fb4abcc75c80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:33.727240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c5097-81b2-4f4c-8008-fb4abcc75c80 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-0b2c5097-81b2-4f4c-8008-fb4abcc75c80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:33.746857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:33.747873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:33.748822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:33.751484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 275/552] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:33.753383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e6a90-b1ff-4284-b43c-8f514a82fda3 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:33.753859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e6a90-b1ff-4284-b43c-8f514a82fda3 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:33.754308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e6a90-b1ff-4284-b43c-8f514a82fda3 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:33.756271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 276/553] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:33.760715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e6a90-b1ff-4284-b43c-8f514a82fda3 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:33.773579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f14274-b2a7-4b32-81e7-3500662025e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:33.774518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14274-b2a7-4b32-81e7-3500662025e6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:33.774973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14274-b2a7-4b32-81e7-3500662025e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:33.775552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14274-b2a7-4b32-81e7-3500662025e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:33.789468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f14274-b2a7-4b32-81e7-3500662025e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:33.791432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f14274-b2a7-4b32-81e7-3500662025e6 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-b4f14274-b2a7-4b32-81e7-3500662025e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:33.809237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:33.810236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:33.811086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:33.811086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:33.811086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:33.813397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 278/554] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:33.820396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b1046-87d6-402a-a38e-5c5a47c0959e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:33.821141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b1046-87d6-402a-a38e-5c5a47c0959e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:33.821561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b1046-87d6-402a-a38e-5c5a47c0959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:33.843094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-406b1046-87d6-402a-a38e-5c5a47c0959e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:33.845221 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-406b1046-87d6-402a-a38e-5c5a47c0959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:33.916136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e6a90-b1ff-4284-b43c-8f514a82fda3 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:33.933726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 279/555] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:33.934864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b1046-87d6-402a-a38e-5c5a47c0959e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:33.980048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:33.987609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6817cc-8c45-46b6-86d4-7ad2c25529be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:33.988250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6817cc-8c45-46b6-86d4-7ad2c25529be None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:33.988964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6817cc-8c45-46b6-86d4-7ad2c25529be None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:33.989237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6817cc-8c45-46b6-86d4-7ad2c25529be None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:33.989981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6817cc-8c45-46b6-86d4-7ad2c25529be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:33.990279 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6817cc-8c45-46b6-86d4-7ad2c25529be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:33.995313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6817cc-8c45-46b6-86d4-7ad2c25529be None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:34.025157 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 277/556] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 19:40:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:34.031020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6817cc-8c45-46b6-86d4-7ad2c25529be None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:34.057229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:34.106523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b1046-87d6-402a-a38e-5c5a47c0959e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:34.181230 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0862b-d167-40ab-ab3a-b6e17228c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:34.182640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0862b-d167-40ab-ab3a-b6e17228c052 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:34.183119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0862b-d167-40ab-ab3a-b6e17228c052 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:34.183610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0862b-d167-40ab-ab3a-b6e17228c052 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:34.184510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0862b-d167-40ab-ab3a-b6e17228c052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:34.186706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0862b-d167-40ab-ab3a-b6e17228c052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:34.188433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0862b-d167-40ab-ab3a-b6e17228c052 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:34.215743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6817cc-8c45-46b6-86d4-7ad2c25529be None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:34.217450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 280/557] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:34.225203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0862b-d167-40ab-ab3a-b6e17228c052 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:34.263139 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd4a2f-539e-43ac-bfa9-2d4a719d7706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:34.265283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd4a2f-539e-43ac-bfa9-2d4a719d7706 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:34.265815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd4a2f-539e-43ac-bfa9-2d4a719d7706 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:34.266461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd4a2f-539e-43ac-bfa9-2d4a719d7706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:34.354399 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd4a2f-539e-43ac-bfa9-2d4a719d7706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:34.355963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd4a2f-539e-43ac-bfa9-2d4a719d7706 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:34.363610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:34.367346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:34.371975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0862b-d167-40ab-ab3a-b6e17228c052 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:34.414334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea9e86-f0a2-4977-b019-7918cd289f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:34.420037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9e86-f0a2-4977-b019-7918cd289f75 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:34.420037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9e86-f0a2-4977-b019-7918cd289f75 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:34.420037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9e86-f0a2-4977-b019-7918cd289f75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:34.423209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea9e86-f0a2-4977-b019-7918cd289f75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:34.424725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea9e86-f0a2-4977-b019-7918cd289f75 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-8bea9e86-f0a2-4977-b019-7918cd289f75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:34.436358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:34.438157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 281/558] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 19:40:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d033da-0aef-4072-b6c9-f7b18f69703a None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:34.439108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d033da-0aef-4072-b6c9-f7b18f69703a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:34.439865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d033da-0aef-4072-b6c9-f7b18f69703a None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:34.441113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 282/559] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:34.441870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d033da-0aef-4072-b6c9-f7b18f69703a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:34.484811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 278/560] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:34.485897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd4a2f-539e-43ac-bfa9-2d4a719d7706 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:34.557442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d033da-0aef-4072-b6c9-f7b18f69703a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:34.593114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dd774-bb39-4b0f-abbb-cb4d0517059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:34.593751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dd774-bb39-4b0f-abbb-cb4d0517059c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:34.594028 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dd774-bb39-4b0f-abbb-cb4d0517059c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:34.594296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dd774-bb39-4b0f-abbb-cb4d0517059c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:34.600738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd4a2f-539e-43ac-bfa9-2d4a719d7706 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:34.606879 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dd774-bb39-4b0f-abbb-cb4d0517059c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:34.612511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-504dd774-bb39-4b0f-abbb-cb4d0517059c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:34.612964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:34.613892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:34.614734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 283/561] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:34.615471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832244c4-a8d6-4ec6-95e0-b179045ec1ed None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:34.615874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832244c4-a8d6-4ec6-95e0-b179045ec1ed None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:34.615874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832244c4-a8d6-4ec6-95e0-b179045ec1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:34.635522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-832244c4-a8d6-4ec6-95e0-b179045ec1ed None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:34.636766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-832244c4-a8d6-4ec6-95e0-b179045ec1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:34.640964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aa22b-b3b4-444c-bc03-591e4c7f92e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:34.641595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aa22b-b3b4-444c-bc03-591e4c7f92e2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:34.641874 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aa22b-b3b4-444c-bc03-591e4c7f92e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:34.642144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aa22b-b3b4-444c-bc03-591e4c7f92e2 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:34.642922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aa22b-b3b4-444c-bc03-591e4c7f92e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:34.643250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aa22b-b3b4-444c-bc03-591e4c7f92e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:34.644884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aa22b-b3b4-444c-bc03-591e4c7f92e2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:34.648475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:34.668449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 279/562] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 19:40:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:34.668449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aa22b-b3b4-444c-bc03-591e4c7f92e2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:34.727342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 284/563] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:34.727342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832244c4-a8d6-4ec6-95e0-b179045ec1ed None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:34.785705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aa22b-b3b4-444c-bc03-591e4c7f92e2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:34.823341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4273b7-67e9-46e4-bfb4-6aa39258ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:34.824084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4273b7-67e9-46e4-bfb4-6aa39258ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:34.824512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4273b7-67e9-46e4-bfb4-6aa39258ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:34.824793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4273b7-67e9-46e4-bfb4-6aa39258ccc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:34.838401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4273b7-67e9-46e4-bfb4-6aa39258ccc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:34.840468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4273b7-67e9-46e4-bfb4-6aa39258ccc6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:34.846171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832244c4-a8d6-4ec6-95e0-b179045ec1ed None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-bc4273b7-67e9-46e4-bfb4-6aa39258ccc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:34.859091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:34.860133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:34.861021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:34.861021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:34.861021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:34.863386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 280/564] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:34.864206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4273b7-67e9-46e4-bfb4-6aa39258ccc6 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:34.891062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:34.896053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f36e68-6db9-4c5f-b971-5d485f05902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:34.896880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f36e68-6db9-4c5f-b971-5d485f05902e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:34.897317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f36e68-6db9-4c5f-b971-5d485f05902e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:34.897737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f36e68-6db9-4c5f-b971-5d485f05902e None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:34.898553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f36e68-6db9-4c5f-b971-5d485f05902e None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:34.899001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f36e68-6db9-4c5f-b971-5d485f05902e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:34.900542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f36e68-6db9-4c5f-b971-5d485f05902e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:34.909636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 285/565] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:34.910883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f36e68-6db9-4c5f-b971-5d485f05902e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:34.920700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:34.974517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4273b7-67e9-46e4-bfb4-6aa39258ccc6 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.013675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd9481-e95d-4936-ae84-cca29663cca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.014222 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd9481-e95d-4936-ae84-cca29663cca6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.014496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd9481-e95d-4936-ae84-cca29663cca6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.014764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd9481-e95d-4936-ae84-cca29663cca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.027318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f36e68-6db9-4c5f-b971-5d485f05902e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.027663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd9481-e95d-4936-ae84-cca29663cca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.029200 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd9481-e95d-4936-ae84-cca29663cca6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-fefd9481-e95d-4936-ae84-cca29663cca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:35.047454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:35.048434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:35.050288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:35.050288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:35.050288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:35.050288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 281/566] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:35.050288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd9481-e95d-4936-ae84-cca29663cca6 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.070902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e72f1b-41cb-4fea-9b8f-6337a82e2dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.071796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e72f1b-41cb-4fea-9b8f-6337a82e2dff None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.072227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e72f1b-41cb-4fea-9b8f-6337a82e2dff None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.072654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e72f1b-41cb-4fea-9b8f-6337a82e2dff None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.073473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e72f1b-41cb-4fea-9b8f-6337a82e2dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:35.073782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e72f1b-41cb-4fea-9b8f-6337a82e2dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.075167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e72f1b-41cb-4fea-9b8f-6337a82e2dff None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.093661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 286/567] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:35.093661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e72f1b-41cb-4fea-9b8f-6337a82e2dff None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.136307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:35.161910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:35.168329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd9481-e95d-4936-ae84-cca29663cca6 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.198335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e72f1b-41cb-4fea-9b8f-6337a82e2dff None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.207644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416bbf1-9af9-49f4-8699-2043c854c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.208274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416bbf1-9af9-49f4-8699-2043c854c80f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.208545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416bbf1-9af9-49f4-8699-2043c854c80f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.208805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416bbf1-9af9-49f4-8699-2043c854c80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.219624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416bbf1-9af9-49f4-8699-2043c854c80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.221092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416bbf1-9af9-49f4-8699-2043c854c80f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.234520 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064d959-b74f-4582-93b0-4740958cf3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.235145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064d959-b74f-4582-93b0-4740958cf3c1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-3416bbf1-9af9-49f4-8699-2043c854c80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:35.235291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:35.236195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:35.238327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:35.238327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:35.238327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:35.238536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064d959-b74f-4582-93b0-4740958cf3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.238536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064d959-b74f-4582-93b0-4740958cf3c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.238712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 282/568] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:35.238712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416bbf1-9af9-49f4-8699-2043c854c80f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.247703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064d959-b74f-4582-93b0-4740958cf3c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-f064d959-b74f-4582-93b0-4740958cf3c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:35.252406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:35.253612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 287/569] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:35.254758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064d959-b74f-4582-93b0-4740958cf3c1 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.341122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416bbf1-9af9-49f4-8699-2043c854c80f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.356154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064d959-b74f-4582-93b0-4740958cf3c1 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.365869 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:35.376506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f000cd-5ab6-4bb7-9b7c-bf1b52dd2239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.377106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f000cd-5ab6-4bb7-9b7c-bf1b52dd2239 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.377384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f000cd-5ab6-4bb7-9b7c-bf1b52dd2239 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.377692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f000cd-5ab6-4bb7-9b7c-bf1b52dd2239 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.378566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f000cd-5ab6-4bb7-9b7c-bf1b52dd2239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:35.378868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f000cd-5ab6-4bb7-9b7c-bf1b52dd2239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.380560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f000cd-5ab6-4bb7-9b7c-bf1b52dd2239 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.382397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:35.390965 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f64dc4-8426-42b1-9676-ea783176b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.391619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f64dc4-8426-42b1-9676-ea783176b859 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.391894 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f64dc4-8426-42b1-9676-ea783176b859 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.392162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f64dc4-8426-42b1-9676-ea783176b859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.394596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 283/570] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:35.395939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7660fc-334f-47da-8efe-b3daa6ba1950 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.396218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7660fc-334f-47da-8efe-b3daa6ba1950 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.396488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7660fc-334f-47da-8efe-b3daa6ba1950 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.397759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 284/571] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:35.398448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7660fc-334f-47da-8efe-b3daa6ba1950 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.402830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f64dc4-8426-42b1-9676-ea783176b859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.404339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f64dc4-8426-42b1-9676-ea783176b859 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-31f64dc4-8426-42b1-9676-ea783176b859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:35.417124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:35.418313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 288/572] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:35.419381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f64dc4-8426-42b1-9676-ea783176b859 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.506291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7660fc-334f-47da-8efe-b3daa6ba1950 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.520292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f64dc4-8426-42b1-9676-ea783176b859 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.539370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24233b-4e49-4ecc-82ce-5feb9773880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.539982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24233b-4e49-4ecc-82ce-5feb9773880f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.540260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24233b-4e49-4ecc-82ce-5feb9773880f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.540531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24233b-4e49-4ecc-82ce-5feb9773880f None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.541169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24233b-4e49-4ecc-82ce-5feb9773880f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:35.541473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24233b-4e49-4ecc-82ce-5feb9773880f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.542834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24233b-4e49-4ecc-82ce-5feb9773880f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.558966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 285/573] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:35.558966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24233b-4e49-4ecc-82ce-5feb9773880f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.560116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00257dfc-32f9-468f-a0d4-64c0b73dbf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.560721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00257dfc-32f9-468f-a0d4-64c0b73dbf3a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.560995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00257dfc-32f9-468f-a0d4-64c0b73dbf3a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.561263 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00257dfc-32f9-468f-a0d4-64c0b73dbf3a None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.561928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00257dfc-32f9-468f-a0d4-64c0b73dbf3a None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:35.562223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00257dfc-32f9-468f-a0d4-64c0b73dbf3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.563601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00257dfc-32f9-468f-a0d4-64c0b73dbf3a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.572226 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 289/574] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:35.573395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602dd28-bb75-455a-80f5-45794eb80e5f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.573668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602dd28-bb75-455a-80f5-45794eb80e5f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.573936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602dd28-bb75-455a-80f5-45794eb80e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.591329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e602dd28-bb75-455a-80f5-45794eb80e5f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:35.592451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e602dd28-bb75-455a-80f5-45794eb80e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:35.606053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:35.638098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:35.660717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 290/575] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:35.661378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24233b-4e49-4ecc-82ce-5feb9773880f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.661711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602dd28-bb75-455a-80f5-45794eb80e5f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.697487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03923-58e9-4c38-99b9-21a337378b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.698108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03923-58e9-4c38-99b9-21a337378b30 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.698378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03923-58e9-4c38-99b9-21a337378b30 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.698642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03923-58e9-4c38-99b9-21a337378b30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.705614 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c03923-58e9-4c38-99b9-21a337378b30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.708197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c03923-58e9-4c38-99b9-21a337378b30 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-45c03923-58e9-4c38-99b9-21a337378b30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:35.719420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:35.720474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 286/576] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:35.727144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03923-58e9-4c38-99b9-21a337378b30 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.779199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602dd28-bb75-455a-80f5-45794eb80e5f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.816240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282de79a-7a31-45de-96d1-4e44fa4dd17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.816843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282de79a-7a31-45de-96d1-4e44fa4dd17d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.817145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282de79a-7a31-45de-96d1-4e44fa4dd17d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.817414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282de79a-7a31-45de-96d1-4e44fa4dd17d None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.818110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282de79a-7a31-45de-96d1-4e44fa4dd17d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:35.818669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282de79a-7a31-45de-96d1-4e44fa4dd17d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.820001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282de79a-7a31-45de-96d1-4e44fa4dd17d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.831897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03923-58e9-4c38-99b9-21a337378b30 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.837979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 291/577] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:35.837979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282de79a-7a31-45de-96d1-4e44fa4dd17d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.839522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:35.867112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742fb8a-cc12-48be-893c-66ba0425d292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.867888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742fb8a-cc12-48be-893c-66ba0425d292 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.868514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742fb8a-cc12-48be-893c-66ba0425d292 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.868919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742fb8a-cc12-48be-893c-66ba0425d292 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.880470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742fb8a-cc12-48be-893c-66ba0425d292 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.881204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:35.882516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742fb8a-cc12-48be-893c-66ba0425d292 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-c742fb8a-cc12-48be-893c-66ba0425d292 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:35.894856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:35.895971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:35.896938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 287/578] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:35.897530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742fb8a-cc12-48be-893c-66ba0425d292 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:35.948657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282de79a-7a31-45de-96d1-4e44fa4dd17d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:35.983194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4990c-ee55-4c3d-a80c-3aa999a2eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:35.983851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4990c-ee55-4c3d-a80c-3aa999a2eb89 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:35.984131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4990c-ee55-4c3d-a80c-3aa999a2eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:35.984401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4990c-ee55-4c3d-a80c-3aa999a2eb89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:35.994925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4990c-ee55-4c3d-a80c-3aa999a2eb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:35.996399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4990c-ee55-4c3d-a80c-3aa999a2eb89 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.000915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742fb8a-cc12-48be-893c-66ba0425d292 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-b5f4990c-ee55-4c3d-a80c-3aa999a2eb89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:36.011141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:36.012253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:36.013367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:36.013367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:36.013367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:36.013367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 292/579] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:36.013367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4990c-ee55-4c3d-a80c-3aa999a2eb89 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.036646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6499df3-29dc-43f6-867c-db796a3aac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.037243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6499df3-29dc-43f6-867c-db796a3aac78 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.037516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6499df3-29dc-43f6-867c-db796a3aac78 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.037780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6499df3-29dc-43f6-867c-db796a3aac78 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.038460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6499df3-29dc-43f6-867c-db796a3aac78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:36.038754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6499df3-29dc-43f6-867c-db796a3aac78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.040231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6499df3-29dc-43f6-867c-db796a3aac78 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.052107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 288/580] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:36.052963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6499df3-29dc-43f6-867c-db796a3aac78 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.079062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:36.106855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:36.117050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4990c-ee55-4c3d-a80c-3aa999a2eb89 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.152526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea034a76-e640-4526-bd50-1b44b0eefe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.153047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea034a76-e640-4526-bd50-1b44b0eefe0a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.153317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea034a76-e640-4526-bd50-1b44b0eefe0a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.153584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea034a76-e640-4526-bd50-1b44b0eefe0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.154308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea034a76-e640-4526-bd50-1b44b0eefe0a None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=5a1eeb59bfa24e4bb6658aa4bb5f7852) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:36.154613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea034a76-e640-4526-bd50-1b44b0eefe0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.156090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea034a76-e640-4526-bd50-1b44b0eefe0a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.158351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6499df3-29dc-43f6-867c-db796a3aac78 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.162047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 293/581] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/role_assignments?user.id=5a1eeb59bfa24e4bb6658aa4bb5f7852&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:36.162820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea034a76-e640-4526-bd50-1b44b0eefe0a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.198774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7961f-7fc9-4886-97c7-fbd4e66c713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.199838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7961f-7fc9-4886-97c7-fbd4e66c713a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.200291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7961f-7fc9-4886-97c7-fbd4e66c713a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.200808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7961f-7fc9-4886-97c7-fbd4e66c713a None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.201859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7961f-7fc9-4886-97c7-fbd4e66c713a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:36.202163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7961f-7fc9-4886-97c7-fbd4e66c713a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.203647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7961f-7fc9-4886-97c7-fbd4e66c713a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.226691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 289/582] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:36.228014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7961f-7fc9-4886-97c7-fbd4e66c713a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.283800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea034a76-e640-4526-bd50-1b44b0eefe0a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.323567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477ee64-2255-415b-bae1-5884c070dd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.323784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:36.324358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477ee64-2255-415b-bae1-5884c070dd94 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.324701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477ee64-2255-415b-bae1-5884c070dd94 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.324973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477ee64-2255-415b-bae1-5884c070dd94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.336268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477ee64-2255-415b-bae1-5884c070dd94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-b477ee64-2255-415b-bae1-5884c070dd94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:36.340947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:36.342652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 294/583] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:36.343629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477ee64-2255-415b-bae1-5884c070dd94 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.347693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7961f-7fc9-4886-97c7-fbd4e66c713a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.360276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:36.385480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf083e-d67c-480d-a500-ce3291c99777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.386088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf083e-d67c-480d-a500-ce3291c99777 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.386365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf083e-d67c-480d-a500-ce3291c99777 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.386634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf083e-d67c-480d-a500-ce3291c99777 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.387338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf083e-d67c-480d-a500-ce3291c99777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:36.387639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf083e-d67c-480d-a500-ce3291c99777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.389014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf083e-d67c-480d-a500-ce3291c99777 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.403331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 290/584] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:36.404117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf083e-d67c-480d-a500-ce3291c99777 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.464523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477ee64-2255-415b-bae1-5884c070dd94 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.502200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fae81-d1d8-49ab-8ed1-66b31993a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.503658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fae81-d1d8-49ab-8ed1-66b31993a979 None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.504120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fae81-d1d8-49ab-8ed1-66b31993a979 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.504467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fae81-d1d8-49ab-8ed1-66b31993a979 None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1787fcb6f7c34de59c9682a4d8c3d2a3/roles/4f4fe296a2c34480b2b25ce307b326e6` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.509512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf083e-d67c-480d-a500-ce3291c99777 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.520127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fae81-d1d8-49ab-8ed1-66b31993a979 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=1787fcb6f7c34de59c9682a4d8c3d2a3, role_id=4f4fe296a2c34480b2b25ce307b326e6)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.521576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fae81-d1d8-49ab-8ed1-66b31993a979 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.542939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7b340-6fe7-4ad6-975d-e29b764ccc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.543587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7b340-6fe7-4ad6-975d-e29b764ccc54 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.543862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7b340-6fe7-4ad6-975d-e29b764ccc54 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.544128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7b340-6fe7-4ad6-975d-e29b764ccc54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.554780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7b340-6fe7-4ad6-975d-e29b764ccc54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.556244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7b340-6fe7-4ad6-975d-e29b764ccc54 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.558004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-64d7b340-6fe7-4ad6-975d-e29b764ccc54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:36.571376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:36.572478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:36.573398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:36.573398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:36.573398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:36.573398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 291/585] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:36.573618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7b340-6fe7-4ad6-975d-e29b764ccc54 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.619252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 295/586] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:40:36 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1787fcb6f7c34de59c9682a4d8c3d2a3/roles/4f4fe296a2c34480b2b25ce307b326e6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:36.619252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fae81-d1d8-49ab-8ed1-66b31993a979 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.695089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:36.701115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7b340-6fe7-4ad6-975d-e29b764ccc54 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.741233 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0d74b-a425-4fad-b159-c48315e75ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.741538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fae81-d1d8-49ab-8ed1-66b31993a979 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.741845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0d74b-a425-4fad-b159-c48315e75ff2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.742121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0d74b-a425-4fad-b159-c48315e75ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.742449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0d74b-a425-4fad-b159-c48315e75ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.743140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0d74b-a425-4fad-b159-c48315e75ff2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:36.743467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0d74b-a425-4fad-b159-c48315e75ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.747115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0d74b-a425-4fad-b159-c48315e75ff2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.759078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 292/587] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:36.760121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0d74b-a425-4fad-b159-c48315e75ff2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.793539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0c878-c95d-4b66-9289-ded58da3b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.794343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0c878-c95d-4b66-9289-ded58da3b0dc None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.794696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0c878-c95d-4b66-9289-ded58da3b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.795034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0c878-c95d-4b66-9289-ded58da3b0dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.804291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0c878-c95d-4b66-9289-ded58da3b0dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.805827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0c878-c95d-4b66-9289-ded58da3b0dc None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-b0a0c878-c95d-4b66-9289-ded58da3b0dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:36.820707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:36.821857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 296/588] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:36.822805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0c878-c95d-4b66-9289-ded58da3b0dc None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.843280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:36.895883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0d74b-a425-4fad-b159-c48315e75ff2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.938169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f532edc-3069-430f-be07-cbf0e2ce42a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.938875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532edc-3069-430f-be07-cbf0e2ce42a4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.939158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532edc-3069-430f-be07-cbf0e2ce42a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.939457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532edc-3069-430f-be07-cbf0e2ce42a4 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.940160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f532edc-3069-430f-be07-cbf0e2ce42a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:36.940502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f532edc-3069-430f-be07-cbf0e2ce42a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.941897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f532edc-3069-430f-be07-cbf0e2ce42a4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:36.942030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0c878-c95d-4b66-9289-ded58da3b0dc None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:36.954812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 293/589] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:36.955711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f532edc-3069-430f-be07-cbf0e2ce42a4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:36.967429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:36.978968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee31f00-c017-4cde-b6b3-72a951cd705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:36.980940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee31f00-c017-4cde-b6b3-72a951cd705d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:36.980940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee31f00-c017-4cde-b6b3-72a951cd705d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:36.980940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee31f00-c017-4cde-b6b3-72a951cd705d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:36.992586 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee31f00-c017-4cde-b6b3-72a951cd705d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:36.994290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee31f00-c017-4cde-b6b3-72a951cd705d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-8ee31f00-c017-4cde-b6b3-72a951cd705d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:37.015716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:37.016942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:37.018002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:37.018002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:37.018002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:37.024835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 297/590] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:37.025904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee31f00-c017-4cde-b6b3-72a951cd705d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.090600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f532edc-3069-430f-be07-cbf0e2ce42a4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:37.112674 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:37.136935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42167a90-4e1f-4800-99f1-04d72309c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:37.138029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42167a90-4e1f-4800-99f1-04d72309c131 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:37.138414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42167a90-4e1f-4800-99f1-04d72309c131 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:37.138856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42167a90-4e1f-4800-99f1-04d72309c131 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:37.140014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42167a90-4e1f-4800-99f1-04d72309c131 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:37.140573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42167a90-4e1f-4800-99f1-04d72309c131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:37.142741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42167a90-4e1f-4800-99f1-04d72309c131 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.144985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee31f00-c017-4cde-b6b3-72a951cd705d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:37.171381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 294/591] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 19:40:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:37.173571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42167a90-4e1f-4800-99f1-04d72309c131 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.194066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588760-34b5-4bdb-b961-5779e01d2a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:37.194932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588760-34b5-4bdb-b961-5779e01d2a7c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:37.195254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588760-34b5-4bdb-b961-5779e01d2a7c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:37.195538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588760-34b5-4bdb-b961-5779e01d2a7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:37.203474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0588760-34b5-4bdb-b961-5779e01d2a7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:37.204994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0588760-34b5-4bdb-b961-5779e01d2a7c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-a0588760-34b5-4bdb-b961-5779e01d2a7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:37.217068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:37.217990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:37.218890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:37.218890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:37.218890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:37.218890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:37.218890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:37.218890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:37.218890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:37.218890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:37.223092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 298/592] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:37.224102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588760-34b5-4bdb-b961-5779e01d2a7c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.291652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:37.309912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42167a90-4e1f-4800-99f1-04d72309c131 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:37.335897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588760-34b5-4bdb-b961-5779e01d2a7c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:37.355896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629910f1-9c4e-4caf-bba3-b200dcf51d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:37.357136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629910f1-9c4e-4caf-bba3-b200dcf51d1f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:37.357654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629910f1-9c4e-4caf-bba3-b200dcf51d1f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:37.358144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629910f1-9c4e-4caf-bba3-b200dcf51d1f None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:37.358985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629910f1-9c4e-4caf-bba3-b200dcf51d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:37.359529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629910f1-9c4e-4caf-bba3-b200dcf51d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:37.361087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629910f1-9c4e-4caf-bba3-b200dcf51d1f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.372990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 295/593] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:37.374054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629910f1-9c4e-4caf-bba3-b200dcf51d1f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.410354 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165820d0-bf24-4142-a6ca-9809956f230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:37.410986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165820d0-bf24-4142-a6ca-9809956f230c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:37.411290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165820d0-bf24-4142-a6ca-9809956f230c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:37.411564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165820d0-bf24-4142-a6ca-9809956f230c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:37.412597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:37.424013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165820d0-bf24-4142-a6ca-9809956f230c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:37.427132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165820d0-bf24-4142-a6ca-9809956f230c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-165820d0-bf24-4142-a6ca-9809956f230c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:37.441435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:37.442375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:37.443280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:37.443280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:37.443280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:37.447238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 299/594] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:37.448246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165820d0-bf24-4142-a6ca-9809956f230c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.482770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629910f1-9c4e-4caf-bba3-b200dcf51d1f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:37.520228 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181860a-3bdb-4832-b534-ce56fefe1c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:37.520829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181860a-3bdb-4832-b534-ce56fefe1c7e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:37.521104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181860a-3bdb-4832-b534-ce56fefe1c7e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:37.521370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181860a-3bdb-4832-b534-ce56fefe1c7e None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:37.522066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181860a-3bdb-4832-b534-ce56fefe1c7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:37.522366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181860a-3bdb-4832-b534-ce56fefe1c7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:37.523842 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181860a-3bdb-4832-b534-ce56fefe1c7e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.536706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 296/595] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:37.537634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181860a-3bdb-4832-b534-ce56fefe1c7e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.549373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:37.564861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165820d0-bf24-4142-a6ca-9809956f230c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:37.605106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eaf0d-66ef-4677-97a8-f1ceb12bc5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:37.606114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eaf0d-66ef-4677-97a8-f1ceb12bc5a8 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:37.606533 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eaf0d-66ef-4677-97a8-f1ceb12bc5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:37.607079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eaf0d-66ef-4677-97a8-f1ceb12bc5a8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:37.614994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eaf0d-66ef-4677-97a8-f1ceb12bc5a8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:37.616666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eaf0d-66ef-4677-97a8-f1ceb12bc5a8 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-cf5eaf0d-66ef-4677-97a8-f1ceb12bc5a8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:37.629679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:37.631055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 19:40:37.632093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:37.638617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 300/596] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:37.639814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:37.640893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eaf0d-66ef-4677-97a8-f1ceb12bc5a8 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.644373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181860a-3bdb-4832-b534-ce56fefe1c7e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:37.680501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58447-fb32-49c1-8119-de18a5972015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:37.681102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58447-fb32-49c1-8119-de18a5972015 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:37.681380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58447-fb32-49c1-8119-de18a5972015 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:37.681651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf58447-fb32-49c1-8119-de18a5972015 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:37.682866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58447-fb32-49c1-8119-de18a5972015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:37.682866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58447-fb32-49c1-8119-de18a5972015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:37.684046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf58447-fb32-49c1-8119-de18a5972015 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.697085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 297/597] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:37.698113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58447-fb32-49c1-8119-de18a5972015 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.761698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eaf0d-66ef-4677-97a8-f1ceb12bc5a8 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:37.800530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f044d-6f52-42b0-a3f1-9b7a00be6130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:37.801535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f044d-6f52-42b0-a3f1-9b7a00be6130 None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:37.801978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f044d-6f52-42b0-a3f1-9b7a00be6130 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:37.802398 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f044d-6f52-42b0-a3f1-9b7a00be6130 None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/2422c781c74f44ae83e8b094f1728743/roles/4f4fe296a2c34480b2b25ce307b326e6` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:37.807150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf58447-fb32-49c1-8119-de18a5972015 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:37.819388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f044d-6f52-42b0-a3f1-9b7a00be6130 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=2422c781c74f44ae83e8b094f1728743, role_id=4f4fe296a2c34480b2b25ce307b326e6)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:37.821223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f044d-6f52-42b0-a3f1-9b7a00be6130 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.844754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ca0fa-b19d-4af4-859c-c2c754e8f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:37.845361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ca0fa-b19d-4af4-859c-c2c754e8f3de None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:37.845637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ca0fa-b19d-4af4-859c-c2c754e8f3de None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:37.845901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ca0fa-b19d-4af4-859c-c2c754e8f3de None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:37.847190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ca0fa-b19d-4af4-859c-c2c754e8f3de None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:37.847521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ca0fa-b19d-4af4-859c-c2c754e8f3de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:37.849025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ca0fa-b19d-4af4-859c-c2c754e8f3de None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:37.872396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 298/598] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Aug 22 19:40:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:37.872396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ca0fa-b19d-4af4-859c-c2c754e8f3de None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.882874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:37.887522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:37.895527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 301/599] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:40:37 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/2422c781c74f44ae83e8b094f1728743/roles/4f4fe296a2c34480b2b25ce307b326e6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:37.902118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f044d-6f52-42b0-a3f1-9b7a00be6130 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:37.981538 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ca0fa-b19d-4af4-859c-c2c754e8f3de None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:38.029977 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a98fad-3499-4a7b-a3fa-543861cccb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:38.030549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a98fad-3499-4a7b-a3fa-543861cccb01 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.030825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a98fad-3499-4a7b-a3fa-543861cccb01 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.031092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a98fad-3499-4a7b-a3fa-543861cccb01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.052245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a98fad-3499-4a7b-a3fa-543861cccb01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:38.053737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a98fad-3499-4a7b-a3fa-543861cccb01 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-16a98fad-3499-4a7b-a3fa-543861cccb01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:38.084667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:38.085840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:38.087026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:38.087026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:38.087026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:38.087026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:38.087026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:38.087026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:38.087026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:38.087026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:38.091261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 299/600] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:38.092864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a98fad-3499-4a7b-a3fa-543861cccb01 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:38.101291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f044d-6f52-42b0-a3f1-9b7a00be6130 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:38.148403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da90df-50b3-463b-8c4f-06fc91e1c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:38.149373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da90df-50b3-463b-8c4f-06fc91e1c024 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.149807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da90df-50b3-463b-8c4f-06fc91e1c024 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.150264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da90df-50b3-463b-8c4f-06fc91e1c024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.163341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da90df-50b3-463b-8c4f-06fc91e1c024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:38.164904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da90df-50b3-463b-8c4f-06fc91e1c024 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-a5da90df-50b3-463b-8c4f-06fc91e1c024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:38.181037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:38.182026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:38.182927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:38.182927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:38.182927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:38.183107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:38.183181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 302/601] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:38.183801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38ba48-136f-4f55-8a48-ca8fc54bcd76 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.184092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38ba48-136f-4f55-8a48-ca8fc54bcd76 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.184362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38ba48-136f-4f55-8a48-ca8fc54bcd76 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.185894 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 303/602] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:38.193821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38ba48-136f-4f55-8a48-ca8fc54bcd76 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:38.217031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a98fad-3499-4a7b-a3fa-543861cccb01 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:38.264515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c7082-185b-4092-888d-b8fa8e64409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:38.265565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c7082-185b-4092-888d-b8fa8e64409f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.266119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c7082-185b-4092-888d-b8fa8e64409f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.266507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:38.266681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c7082-185b-4092-888d-b8fa8e64409f None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.268331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c7082-185b-4092-888d-b8fa8e64409f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:38.269084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c7082-185b-4092-888d-b8fa8e64409f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:38.271632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c7082-185b-4092-888d-b8fa8e64409f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:38.286293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 300/603] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:38.288673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269d7b-f2ff-4b86-a53b-82103b75b901 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.289302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269d7b-f2ff-4b86-a53b-82103b75b901 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.289960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269d7b-f2ff-4b86-a53b-82103b75b901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.311753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-61269d7b-f2ff-4b86-a53b-82103b75b901 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:38.313576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-61269d7b-f2ff-4b86-a53b-82103b75b901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:38.332387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38ba48-136f-4f55-8a48-ca8fc54bcd76 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:38.377382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c736fa3-bb05-4ff4-9b31-d906178691f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:38.378748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c736fa3-bb05-4ff4-9b31-d906178691f9 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.379080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c736fa3-bb05-4ff4-9b31-d906178691f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.379438 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c736fa3-bb05-4ff4-9b31-d906178691f9 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.380567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c736fa3-bb05-4ff4-9b31-d906178691f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:38.380965 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c736fa3-bb05-4ff4-9b31-d906178691f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:38.383043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c736fa3-bb05-4ff4-9b31-d906178691f9 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:38.396135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 301/604] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:38.398152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269d7b-f2ff-4b86-a53b-82103b75b901 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:38.411404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 304/605] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:38.417306 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c736fa3-bb05-4ff4-9b31-d906178691f9 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:38.523593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:38.586389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269d7b-f2ff-4b86-a53b-82103b75b901 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:38.602414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c736fa3-bb05-4ff4-9b31-d906178691f9 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:38.623813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:38.643367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b02b6-70b5-432c-9e84-eae675090319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:38.644258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b02b6-70b5-432c-9e84-eae675090319 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.644637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b02b6-70b5-432c-9e84-eae675090319 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.645064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b02b6-70b5-432c-9e84-eae675090319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.653691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b02b6-70b5-432c-9e84-eae675090319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:38.655378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b02b6-70b5-432c-9e84-eae675090319 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-911b02b6-70b5-432c-9e84-eae675090319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:38.667985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:38.669077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:38.670140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:38.670140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:38.670140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:38.670140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:38.670140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:38.670140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:38.670140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:38.670140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:38.671968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 305/606] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:38.677667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b02b6-70b5-432c-9e84-eae675090319 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:38.694476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72a131-4639-4e1d-b2d3-edaa363e963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:38.695382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72a131-4639-4e1d-b2d3-edaa363e963a None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.695766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72a131-4639-4e1d-b2d3-edaa363e963a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.696180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72a131-4639-4e1d-b2d3-edaa363e963a None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/4414630bb2da4523906f0b2dee0c4c4f/roles/4f4fe296a2c34480b2b25ce307b326e6` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.715896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72a131-4639-4e1d-b2d3-edaa363e963a None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=4414630bb2da4523906f0b2dee0c4c4f, role_id=4f4fe296a2c34480b2b25ce307b326e6)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:38.717420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72a131-4639-4e1d-b2d3-edaa363e963a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:38.802676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 302/607] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:40:38 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/4414630bb2da4523906f0b2dee0c4c4f/roles/4f4fe296a2c34480b2b25ce307b326e6 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:38.804354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370607-1523-4647-b956-304b6357b3c7 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.804880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370607-1523-4647-b956-304b6357b3c7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.805436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370607-1523-4647-b956-304b6357b3c7 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.807154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 303/608] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:38.808185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370607-1523-4647-b956-304b6357b3c7 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:38.825780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b02b6-70b5-432c-9e84-eae675090319 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:38.875177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535ebda-1149-4d43-aa24-52cd6f3ce4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:38.875746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ebda-1149-4d43-aa24-52cd6f3ce4a3 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.876026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ebda-1149-4d43-aa24-52cd6f3ce4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.876294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ebda-1149-4d43-aa24-52cd6f3ce4a3 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.877287 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535ebda-1149-4d43-aa24-52cd6f3ce4a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:38.877627 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535ebda-1149-4d43-aa24-52cd6f3ce4a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:38.880272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535ebda-1149-4d43-aa24-52cd6f3ce4a3 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:38.898481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 306/609] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:38.900298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ffb77-717f-4698-bb9f-18c85d09296d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.900792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ffb77-717f-4698-bb9f-18c85d09296d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.901317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ffb77-717f-4698-bb9f-18c85d09296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.921781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f32ffb77-717f-4698-bb9f-18c85d09296d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:38.923560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f32ffb77-717f-4698-bb9f-18c85d09296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:38.931355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370607-1523-4647-b956-304b6357b3c7 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:38.948097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:38.959340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:38.974027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce68c-81c9-4d03-b12b-b1923c497058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:38.974620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce68c-81c9-4d03-b12b-b1923c497058 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:38.974900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce68c-81c9-4d03-b12b-b1923c497058 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:38.975164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce68c-81c9-4d03-b12b-b1923c497058 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:38.988825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ce68c-81c9-4d03-b12b-b1923c497058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-846ce68c-81c9-4d03-b12b-b1923c497058 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:38.993723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:38.996231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 304/610] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:38.997056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce68c-81c9-4d03-b12b-b1923c497058 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:39.028188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 307/611] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:39.029035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ffb77-717f-4698-bb9f-18c85d09296d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:39.146213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce68c-81c9-4d03-b12b-b1923c497058 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:39.159100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ffb77-717f-4698-bb9f-18c85d09296d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:39.185636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb101278-b3b5-49a6-bb41-7c13bdce03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:39.186707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb101278-b3b5-49a6-bb41-7c13bdce03ad None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:39.187354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb101278-b3b5-49a6-bb41-7c13bdce03ad None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:39.187873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb101278-b3b5-49a6-bb41-7c13bdce03ad None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/7500529eff574ca6ae3a9a77d72d2a40/roles/4f4fe296a2c34480b2b25ce307b326e6` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:39.197285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3469e1-ea82-4983-bcf2-bb0560d25d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:39.197895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3469e1-ea82-4983-bcf2-bb0560d25d01 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:39.198174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3469e1-ea82-4983-bcf2-bb0560d25d01 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:39.198492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3469e1-ea82-4983-bcf2-bb0560d25d01 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:39.199168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3469e1-ea82-4983-bcf2-bb0560d25d01 None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:39.199499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3469e1-ea82-4983-bcf2-bb0560d25d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:39.200937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3469e1-ea82-4983-bcf2-bb0560d25d01 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:39.207755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb101278-b3b5-49a6-bb41-7c13bdce03ad None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=7500529eff574ca6ae3a9a77d72d2a40, role_id=4f4fe296a2c34480b2b25ce307b326e6)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:39.209661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb101278-b3b5-49a6-bb41-7c13bdce03ad None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:39.209990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 308/612] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:39.215495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3469e1-ea82-4983-bcf2-bb0560d25d01 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:39.242304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:39.295526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 305/613] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:40:38 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/7500529eff574ca6ae3a9a77d72d2a40/roles/4f4fe296a2c34480b2b25ce307b326e6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:39.325038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3469e1-ea82-4983-bcf2-bb0560d25d01 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:39.364866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09dac-23ff-4f9f-8ff5-8c7450cdd22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:39.365523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09dac-23ff-4f9f-8ff5-8c7450cdd22b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:39.365803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09dac-23ff-4f9f-8ff5-8c7450cdd22b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:39.366043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09dac-23ff-4f9f-8ff5-8c7450cdd22b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:39.377030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b09dac-23ff-4f9f-8ff5-8c7450cdd22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:39.379445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b09dac-23ff-4f9f-8ff5-8c7450cdd22b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-e1b09dac-23ff-4f9f-8ff5-8c7450cdd22b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:39.402590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:39.403632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:39.404542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:39.404542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:39.404542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:39.410183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 309/614] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:39.415814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb101278-b3b5-49a6-bb41-7c13bdce03ad None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:39.418311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09dac-23ff-4f9f-8ff5-8c7450cdd22b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:39.458232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:39.545780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:39.579726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09dac-23ff-4f9f-8ff5-8c7450cdd22b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:39.592158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb101278-b3b5-49a6-bb41-7c13bdce03ad None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:39.632320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f343a7f-b9f4-4d49-974f-3edc437bb6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:39.633075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f343a7f-b9f4-4d49-974f-3edc437bb6c1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:39.633421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f343a7f-b9f4-4d49-974f-3edc437bb6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:39.633763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f343a7f-b9f4-4d49-974f-3edc437bb6c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:39.636638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11628-bbd2-44df-8a7c-4d9967917d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:39.637464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11628-bbd2-44df-8a7c-4d9967917d9f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:39.637914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11628-bbd2-44df-8a7c-4d9967917d9f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:39.638353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11628-bbd2-44df-8a7c-4d9967917d9f None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:39.639172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec11628-bbd2-44df-8a7c-4d9967917d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:39.639731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec11628-bbd2-44df-8a7c-4d9967917d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:39.641494 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec11628-bbd2-44df-8a7c-4d9967917d9f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:39.646302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f343a7f-b9f4-4d49-974f-3edc437bb6c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-1f343a7f-b9f4-4d49-974f-3edc437bb6c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:39.652782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:39.653683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:39.654513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 310/615] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:39.659371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 306/616] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:39.661953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f343a7f-b9f4-4d49-974f-3edc437bb6c1 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:39.662892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11628-bbd2-44df-8a7c-4d9967917d9f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:39.786055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:39.807817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11628-bbd2-44df-8a7c-4d9967917d9f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:39.833026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f343a7f-b9f4-4d49-974f-3edc437bb6c1 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:39.872397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672dfe-d528-474d-9397-ff75dc322d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:39.873655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672dfe-d528-474d-9397-ff75dc322d96 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:39.874129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672dfe-d528-474d-9397-ff75dc322d96 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:39.874594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672dfe-d528-474d-9397-ff75dc322d96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:39.883068 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a672dfe-d528-474d-9397-ff75dc322d96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:39.884931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a672dfe-d528-474d-9397-ff75dc322d96 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-3a672dfe-d528-474d-9397-ff75dc322d96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:39.897022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:39.897951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:39.898873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:39.901497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 307/617] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:39.906763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672dfe-d528-474d-9397-ff75dc322d96 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:39.912637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb29ee6-0a05-45ba-8d5a-2cf45802d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:39.913529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb29ee6-0a05-45ba-8d5a-2cf45802d453 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:39.915785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb29ee6-0a05-45ba-8d5a-2cf45802d453 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:39.916269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb29ee6-0a05-45ba-8d5a-2cf45802d453 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:39.917896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb29ee6-0a05-45ba-8d5a-2cf45802d453 None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:39.922568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb29ee6-0a05-45ba-8d5a-2cf45802d453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:39.924223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb29ee6-0a05-45ba-8d5a-2cf45802d453 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:39.927523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:39.947554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 311/618] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:39.962502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb29ee6-0a05-45ba-8d5a-2cf45802d453 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:40.075469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb29ee6-0a05-45ba-8d5a-2cf45802d453 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:40.114576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736338-0e02-44d6-8de2-6b7f04161853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:40.114791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672dfe-d528-474d-9397-ff75dc322d96 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:40.115212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736338-0e02-44d6-8de2-6b7f04161853 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.115518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736338-0e02-44d6-8de2-6b7f04161853 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.115793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736338-0e02-44d6-8de2-6b7f04161853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.126463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736338-0e02-44d6-8de2-6b7f04161853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:40.128567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736338-0e02-44d6-8de2-6b7f04161853 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-ba736338-0e02-44d6-8de2-6b7f04161853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:40.143631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:40.144840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:40.145903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:40.145903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:40.145903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:40.145903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 312/619] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:40.146940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b48a7-cbe9-447d-833f-2f7de009c80a None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.146940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b48a7-cbe9-447d-833f-2f7de009c80a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.146940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b48a7-cbe9-447d-833f-2f7de009c80a None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.152997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 313/620] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:40.153767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b48a7-cbe9-447d-833f-2f7de009c80a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:40.156405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b41a0-0112-416d-959c-45e54dfa9486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:40.157673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b41a0-0112-416d-959c-45e54dfa9486 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.157963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b41a0-0112-416d-959c-45e54dfa9486 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.158292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b41a0-0112-416d-959c-45e54dfa9486 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.159149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b41a0-0112-416d-959c-45e54dfa9486 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:40.159541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b41a0-0112-416d-959c-45e54dfa9486 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:40.161051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b41a0-0112-416d-959c-45e54dfa9486 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:40.176593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:40.180389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 308/621] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 19:40:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:40.181773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea6fec-a410-4a3a-9143-97d43b1a5edb None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.182120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea6fec-a410-4a3a-9143-97d43b1a5edb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.182457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea6fec-a410-4a3a-9143-97d43b1a5edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.202665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-3eea6fec-a410-4a3a-9143-97d43b1a5edb None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:40.204037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3eea6fec-a410-4a3a-9143-97d43b1a5edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:40.220907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:40.283162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b48a7-cbe9-447d-833f-2f7de009c80a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:40.294736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 309/622] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:40.296478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea6fec-a410-4a3a-9143-97d43b1a5edb None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:40.321355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196d74-b1c6-4f8b-bf44-7a45f6fd20dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:40.322048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196d74-b1c6-4f8b-bf44-7a45f6fd20dc None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.322401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196d74-b1c6-4f8b-bf44-7a45f6fd20dc None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.322740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196d74-b1c6-4f8b-bf44-7a45f6fd20dc None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.323504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196d74-b1c6-4f8b-bf44-7a45f6fd20dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:40.324057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196d74-b1c6-4f8b-bf44-7a45f6fd20dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:40.325303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196d74-b1c6-4f8b-bf44-7a45f6fd20dc None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:40.338667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 314/623] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:40.344083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196d74-b1c6-4f8b-bf44-7a45f6fd20dc None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:40.436573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea6fec-a410-4a3a-9143-97d43b1a5edb None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:40.456126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196d74-b1c6-4f8b-bf44-7a45f6fd20dc None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:40.466167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:40.476520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:40.483780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd0bc4-252f-438c-bada-e150747cb972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:40.484539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd0bc4-252f-438c-bada-e150747cb972 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.484999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd0bc4-252f-438c-bada-e150747cb972 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.485275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd0bc4-252f-438c-bada-e150747cb972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.493571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c457c9-fb6b-4ded-99cf-5f64298cb4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:40.494375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c457c9-fb6b-4ded-99cf-5f64298cb4ce None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.494757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c457c9-fb6b-4ded-99cf-5f64298cb4ce None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.495128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c457c9-fb6b-4ded-99cf-5f64298cb4ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.498166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd0bc4-252f-438c-bada-e150747cb972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:40.500129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd0bc4-252f-438c-bada-e150747cb972 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:40.503942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c457c9-fb6b-4ded-99cf-5f64298cb4ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:40.505825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c457c9-fb6b-4ded-99cf-5f64298cb4ce None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-89fd0bc4-252f-438c-bada-e150747cb972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:40.516510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:40.517664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:40.519017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:40.519017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:40.519017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:40.519017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 310/624] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-81c457c9-fb6b-4ded-99cf-5f64298cb4ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:40.523248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:40.524231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:40.525178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 315/625] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 19:40:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:40.527184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c457c9-fb6b-4ded-99cf-5f64298cb4ce None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:40.527784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd0bc4-252f-438c-bada-e150747cb972 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:40.652669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c457c9-fb6b-4ded-99cf-5f64298cb4ce None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:40.697020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75496e0-7d76-4d84-a808-211046666c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:40.697711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75496e0-7d76-4d84-a808-211046666c5d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.698083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75496e0-7d76-4d84-a808-211046666c5d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.698448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75496e0-7d76-4d84-a808-211046666c5d None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.699191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75496e0-7d76-4d84-a808-211046666c5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:40.700145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75496e0-7d76-4d84-a808-211046666c5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:40.702429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75496e0-7d76-4d84-a808-211046666c5d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:40.712716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd0bc4-252f-438c-bada-e150747cb972 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:40.718835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 316/626] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:40.720230 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75496e0-7d76-4d84-a808-211046666c5d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:40.748859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de3338-4f24-45aa-92ad-28c7e31558a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:40.749462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de3338-4f24-45aa-92ad-28c7e31558a0 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.749738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de3338-4f24-45aa-92ad-28c7e31558a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.750003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de3338-4f24-45aa-92ad-28c7e31558a0 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.750784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de3338-4f24-45aa-92ad-28c7e31558a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:40.751085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de3338-4f24-45aa-92ad-28c7e31558a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:40.752761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de3338-4f24-45aa-92ad-28c7e31558a0 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:40.759603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:40.774068 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 311/627] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 19:40:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:40.776010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de3338-4f24-45aa-92ad-28c7e31558a0 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:40.837644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:40.841542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75496e0-7d76-4d84-a808-211046666c5d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:40.878001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d73ce-c74d-4a7e-9601-298399178bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:40.878654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d73ce-c74d-4a7e-9601-298399178bd3 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.878930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d73ce-c74d-4a7e-9601-298399178bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.879199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d73ce-c74d-4a7e-9601-298399178bd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.890571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d73ce-c74d-4a7e-9601-298399178bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-843d73ce-c74d-4a7e-9601-298399178bd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:40.896101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:40.897228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:40.898266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:40.901822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 317/628] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:40.902714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d73ce-c74d-4a7e-9601-298399178bd3 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:40.913939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de3338-4f24-45aa-92ad-28c7e31558a0 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:40.957947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9f6d-be31-4c03-9347-00ba9501f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:40.958896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9f6d-be31-4c03-9347-00ba9501f06d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:40.959178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9f6d-be31-4c03-9347-00ba9501f06d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:40.959493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a9f6d-be31-4c03-9347-00ba9501f06d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:40.969866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a9f6d-be31-4c03-9347-00ba9501f06d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:40.972050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a9f6d-be31-4c03-9347-00ba9501f06d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-1b6a9f6d-be31-4c03-9347-00ba9501f06d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:40.983828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:40.984853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:40.985978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:40.985978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:40.985978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:40.985978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:40.985978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:40.985978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:40.985978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:40.985978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:40.990361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 312/629] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:40.990802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9f6d-be31-4c03-9347-00ba9501f06d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:41.014368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:41.032162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d73ce-c74d-4a7e-9601-298399178bd3 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:41.082531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53db183-a6c8-4008-b961-5b3ab1df3690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:41.083689 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53db183-a6c8-4008-b961-5b3ab1df3690 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.084116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53db183-a6c8-4008-b961-5b3ab1df3690 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.084780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53db183-a6c8-4008-b961-5b3ab1df3690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.099873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:41.102890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a9f6d-be31-4c03-9347-00ba9501f06d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:41.141591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e094-5475-4b1c-9dc3-1c03e6821b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:41.142310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e094-5475-4b1c-9dc3-1c03e6821b6e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.142648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e094-5475-4b1c-9dc3-1c03e6821b6e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.142927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e094-5475-4b1c-9dc3-1c03e6821b6e None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.144641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e094-5475-4b1c-9dc3-1c03e6821b6e None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:41.144806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e094-5475-4b1c-9dc3-1c03e6821b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:41.146393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e094-5475-4b1c-9dc3-1c03e6821b6e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:41.159984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 313/630] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:41.159984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e094-5475-4b1c-9dc3-1c03e6821b6e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:41.186552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53db183-a6c8-4008-b961-5b3ab1df3690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:41.189175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53db183-a6c8-4008-b961-5b3ab1df3690 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:41.269244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e094-5475-4b1c-9dc3-1c03e6821b6e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:41.294833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:41.305408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a97eb1-9e92-48aa-b947-0462736ceec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:41.306011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97eb1-9e92-48aa-b947-0462736ceec9 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.306290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97eb1-9e92-48aa-b947-0462736ceec9 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.306611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97eb1-9e92-48aa-b947-0462736ceec9 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.307334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97eb1-9e92-48aa-b947-0462736ceec9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:41.307638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97eb1-9e92-48aa-b947-0462736ceec9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:41.309068 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97eb1-9e92-48aa-b947-0462736ceec9 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:41.313753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 318/631] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:41.313753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53db183-a6c8-4008-b961-5b3ab1df3690 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:41.331046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 314/632] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:41.331046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b17fd-b03f-47e0-9ca7-27636e31ae53 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.331046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b17fd-b03f-47e0-9ca7-27636e31ae53 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.331046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b17fd-b03f-47e0-9ca7-27636e31ae53 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.331046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 315/633] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:41.331046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b17fd-b03f-47e0-9ca7-27636e31ae53 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:41.355490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:41.433746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53db183-a6c8-4008-b961-5b3ab1df3690 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:41.442757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b17fd-b03f-47e0-9ca7-27636e31ae53 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:41.473774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424b635-7ade-494b-a1ee-4f60f3f6b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:41.474423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424b635-7ade-494b-a1ee-4f60f3f6b584 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.474772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424b635-7ade-494b-a1ee-4f60f3f6b584 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.474940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424b635-7ade-494b-a1ee-4f60f3f6b584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.480789 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8a50b-01c1-46a3-a95a-f581ca64ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:41.481772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8a50b-01c1-46a3-a95a-f581ca64ed20 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.482224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8a50b-01c1-46a3-a95a-f581ca64ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.482664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8a50b-01c1-46a3-a95a-f581ca64ed20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.484943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424b635-7ade-494b-a1ee-4f60f3f6b584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:41.486394 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424b635-7ade-494b-a1ee-4f60f3f6b584 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:41.494258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8a50b-01c1-46a3-a95a-f581ca64ed20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:41.496110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8a50b-01c1-46a3-a95a-f581ca64ed20 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-d424b635-7ade-494b-a1ee-4f60f3f6b584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:41.501092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:41.502184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:41.503110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:41.503110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:41.503110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:41.503110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 319/634] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:41.503703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424b635-7ade-494b-a1ee-4f60f3f6b584 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-92e8a50b-01c1-46a3-a95a-f581ca64ed20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:41.517181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:41.518839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:41.520071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:41.520071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:41.520071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:41.521549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 316/635] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:41.522981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85a05-e350-4dfa-819d-e27d9464721b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.523302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85a05-e350-4dfa-819d-e27d9464721b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.523574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85a05-e350-4dfa-819d-e27d9464721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.542323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-c4b85a05-e350-4dfa-819d-e27d9464721b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:41.543773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c4b85a05-e350-4dfa-819d-e27d9464721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:41.554019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:41.622725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 317/636] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:41.623771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85a05-e350-4dfa-819d-e27d9464721b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:41.626920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:41.636481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424b635-7ade-494b-a1ee-4f60f3f6b584 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:41.680795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c8158-6a39-4b8b-a3ad-8b8612425ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:41.681723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c8158-6a39-4b8b-a3ad-8b8612425ee6 None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.682007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c8158-6a39-4b8b-a3ad-8b8612425ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.682276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c8158-6a39-4b8b-a3ad-8b8612425ee6 None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/5a1eeb59bfa24e4bb6658aa4bb5f7852/roles/4f4fe296a2c34480b2b25ce307b326e6` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.701077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c8158-6a39-4b8b-a3ad-8b8612425ee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=5a1eeb59bfa24e4bb6658aa4bb5f7852, role_id=4f4fe296a2c34480b2b25ce307b326e6)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:41.703024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c8158-6a39-4b8b-a3ad-8b8612425ee6 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:41.739078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85a05-e350-4dfa-819d-e27d9464721b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:41.773533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ed45-f9ed-491b-9415-552efdc7a74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:41.774064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ed45-f9ed-491b-9415-552efdc7a74b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.774339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ed45-f9ed-491b-9415-552efdc7a74b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.774604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ed45-f9ed-491b-9415-552efdc7a74b None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.775255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ed45-f9ed-491b-9415-552efdc7a74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:41.775562 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ed45-f9ed-491b-9415-552efdc7a74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:41.776914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ed45-f9ed-491b-9415-552efdc7a74b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:41.785394 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 320/637] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:40:41 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/5a1eeb59bfa24e4bb6658aa4bb5f7852/roles/4f4fe296a2c34480b2b25ce307b326e6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:41.791368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 318/638] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:41.800401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b8436-9ac2-4910-866b-da80959fb4db None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.800526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c8158-6a39-4b8b-a3ad-8b8612425ee6 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:41.800620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b8436-9ac2-4910-866b-da80959fb4db None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.800620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b8436-9ac2-4910-866b-da80959fb4db None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.800620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 319/639] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:41.800620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b8436-9ac2-4910-866b-da80959fb4db None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:41.892334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:41.916242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:41.926704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c8158-6a39-4b8b-a3ad-8b8612425ee6 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:41.940551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b8436-9ac2-4910-866b-da80959fb4db None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:41.970662 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e07767-46fe-4d16-b545-5b0c0f793809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:41.972022 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e07767-46fe-4d16-b545-5b0c0f793809 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.972359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e07767-46fe-4d16-b545-5b0c0f793809 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.972815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e07767-46fe-4d16-b545-5b0c0f793809 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.973463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e07767-46fe-4d16-b545-5b0c0f793809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:41.973762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e07767-46fe-4d16-b545-5b0c0f793809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:41.975124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e07767-46fe-4d16-b545-5b0c0f793809 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:41.977419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f7195-69e7-4cd1-9fd4-1764535f6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:41.978273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f7195-69e7-4cd1-9fd4-1764535f6c8b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.978555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f7195-69e7-4cd1-9fd4-1764535f6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.978824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f7195-69e7-4cd1-9fd4-1764535f6c8b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:41.986914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 321/640] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:41.987623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f7195-69e7-4cd1-9fd4-1764535f6c8b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:41.989443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f7195-69e7-4cd1-9fd4-1764535f6c8b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:41.989834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0972-d760-450f-95c8-cd2754a1feb9 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:41.990753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0972-d760-450f-95c8-cd2754a1feb9 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:41.991276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0972-d760-450f-95c8-cd2754a1feb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-cd2f7195-69e7-4cd1-9fd4-1764535f6c8b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:42.002351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:42.004025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 320/641] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:42.005408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f7195-69e7-4cd1-9fd4-1764535f6c8b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.013523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d16b0972-d760-450f-95c8-cd2754a1feb9 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:42.014899 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d16b0972-d760-450f-95c8-cd2754a1feb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:42.088386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 322/642] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:42.089273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0972-d760-450f-95c8-cd2754a1feb9 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.135661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f7195-69e7-4cd1-9fd4-1764535f6c8b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:42.180672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3363f7-a71b-40a8-b002-76e5e7b27aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:42.181314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3363f7-a71b-40a8-b002-76e5e7b27aa6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:42.181597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3363f7-a71b-40a8-b002-76e5e7b27aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:42.181876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3363f7-a71b-40a8-b002-76e5e7b27aa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.186808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:42.192019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:42.196724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3363f7-a71b-40a8-b002-76e5e7b27aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-bc3363f7-a71b-40a8-b002-76e5e7b27aa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:42.202324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:42.203339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:42.204209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:42.208382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 321/643] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:42.209230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3363f7-a71b-40a8-b002-76e5e7b27aa6 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.214725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0972-d760-450f-95c8-cd2754a1feb9 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:42.261176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98814c6-e240-4253-84cf-6f5239db202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:42.262222 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98814c6-e240-4253-84cf-6f5239db202c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:42.263021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98814c6-e240-4253-84cf-6f5239db202c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:42.263645 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98814c6-e240-4253-84cf-6f5239db202c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.272969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98814c6-e240-4253-84cf-6f5239db202c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:42.275070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98814c6-e240-4253-84cf-6f5239db202c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-a98814c6-e240-4253-84cf-6f5239db202c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:42.289136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:42.290269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:42.291482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:42.291482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:42.291482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:42.291482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:42.291482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:42.291482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:42.291482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:42.291482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:42.296157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 323/644] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:42.300803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98814c6-e240-4253-84cf-6f5239db202c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.331442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3363f7-a71b-40a8-b002-76e5e7b27aa6 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:42.375090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef6c1-9d37-488b-a497-d2c6e0e03d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:42.376091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef6c1-9d37-488b-a497-d2c6e0e03d0b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:42.376586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef6c1-9d37-488b-a497-d2c6e0e03d0b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:42.377002 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef6c1-9d37-488b-a497-d2c6e0e03d0b None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.378458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ef6c1-9d37-488b-a497-d2c6e0e03d0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:42.379369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ef6c1-9d37-488b-a497-d2c6e0e03d0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:42.381082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ef6c1-9d37-488b-a497-d2c6e0e03d0b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:42.399938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 322/645] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:42.400906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef6c1-9d37-488b-a497-d2c6e0e03d0b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.415527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98814c6-e240-4253-84cf-6f5239db202c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:42.453069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ef0d1-acf8-4171-b86b-a1c31a65005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:42.453672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef0d1-acf8-4171-b86b-a1c31a65005d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:42.453949 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef0d1-acf8-4171-b86b-a1c31a65005d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:42.454213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef0d1-acf8-4171-b86b-a1c31a65005d None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.454396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:42.454883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ef0d1-acf8-4171-b86b-a1c31a65005d None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:42.455163 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ef0d1-acf8-4171-b86b-a1c31a65005d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:42.457283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ef0d1-acf8-4171-b86b-a1c31a65005d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:42.469898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 324/646] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:42.469898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ef0d1-acf8-4171-b86b-a1c31a65005d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.473451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:42.522987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef6c1-9d37-488b-a497-d2c6e0e03d0b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:42.558813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb27c44-9b6c-497b-8614-a3ae3b7d7587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:42.559446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb27c44-9b6c-497b-8614-a3ae3b7d7587 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:42.559727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb27c44-9b6c-497b-8614-a3ae3b7d7587 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:42.559999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb27c44-9b6c-497b-8614-a3ae3b7d7587 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.560682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb27c44-9b6c-497b-8614-a3ae3b7d7587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:42.560983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb27c44-9b6c-497b-8614-a3ae3b7d7587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:42.562415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb27c44-9b6c-497b-8614-a3ae3b7d7587 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:42.572254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ef0d1-acf8-4171-b86b-a1c31a65005d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:42.574851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 323/647] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:42.575691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb27c44-9b6c-497b-8614-a3ae3b7d7587 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.611912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773040d-557c-47f9-a1d2-97c5d774fbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:42.612878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773040d-557c-47f9-a1d2-97c5d774fbe6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:42.613152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773040d-557c-47f9-a1d2-97c5d774fbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:42.613419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773040d-557c-47f9-a1d2-97c5d774fbe6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.624063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773040d-557c-47f9-a1d2-97c5d774fbe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-e773040d-557c-47f9-a1d2-97c5d774fbe6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:42.629747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:42.630903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:42.631797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 325/648] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:42.632486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773040d-557c-47f9-a1d2-97c5d774fbe6 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.683362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb27c44-9b6c-497b-8614-a3ae3b7d7587 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:42.685022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:42.701913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:42.722398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ca785-8e06-4713-9068-4b165dd1c2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:42.722999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ca785-8e06-4713-9068-4b165dd1c2ed None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:42.723305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ca785-8e06-4713-9068-4b165dd1c2ed None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:42.723579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ca785-8e06-4713-9068-4b165dd1c2ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.742523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773040d-557c-47f9-a1d2-97c5d774fbe6 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:42.778550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb040ca-d964-48ad-b6a3-484dff17f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:42.779181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb040ca-d964-48ad-b6a3-484dff17f077 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:42.779485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb040ca-d964-48ad-b6a3-484dff17f077 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:42.779755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb040ca-d964-48ad-b6a3-484dff17f077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.791059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb040ca-d964-48ad-b6a3-484dff17f077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:42.792539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb040ca-d964-48ad-b6a3-484dff17f077 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:42.800941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ca785-8e06-4713-9068-4b165dd1c2ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:42.802688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ca785-8e06-4713-9068-4b165dd1c2ed None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-afb040ca-d964-48ad-b6a3-484dff17f077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:42.807626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:42.808735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:42.809803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:42.809803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:42.809803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:42.813496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 326/649] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:42.814315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb040ca-d964-48ad-b6a3-484dff17f077 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.915166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb040ca-d964-48ad-b6a3-484dff17f077 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:42.920358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 324/650] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:42.921601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ca785-8e06-4713-9068-4b165dd1c2ed None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:42.924201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:42.930683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:42.952171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565660e-460b-4a13-a2fa-d7d73b2dfe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:42.952776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565660e-460b-4a13-a2fa-d7d73b2dfe7a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:42.953055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565660e-460b-4a13-a2fa-d7d73b2dfe7a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:42.953322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565660e-460b-4a13-a2fa-d7d73b2dfe7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:42.954046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565660e-460b-4a13-a2fa-d7d73b2dfe7a None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1787fcb6f7c34de59c9682a4d8c3d2a3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:42.954518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565660e-460b-4a13-a2fa-d7d73b2dfe7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:42.955982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565660e-460b-4a13-a2fa-d7d73b2dfe7a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:42.961803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 327/651] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/role_assignments?user.id=1787fcb6f7c34de59c9682a4d8c3d2a3&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:42.962588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565660e-460b-4a13-a2fa-d7d73b2dfe7a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.053375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ca785-8e06-4713-9068-4b165dd1c2ed None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.095141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c11f8-7f04-4aa9-9599-ee19a0539f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.096978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c11f8-7f04-4aa9-9599-ee19a0539f1e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.097556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c11f8-7f04-4aa9-9599-ee19a0539f1e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.098027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c11f8-7f04-4aa9-9599-ee19a0539f1e None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.098907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c11f8-7f04-4aa9-9599-ee19a0539f1e None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:43.099435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c11f8-7f04-4aa9-9599-ee19a0539f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.101047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c11f8-7f04-4aa9-9599-ee19a0539f1e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.105529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565660e-460b-4a13-a2fa-d7d73b2dfe7a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.115626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 325/652] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:43.116900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c11f8-7f04-4aa9-9599-ee19a0539f1e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.156241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6263b1f-81ec-48fb-8a70-280f468cc78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.156862 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6263b1f-81ec-48fb-8a70-280f468cc78f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.157137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6263b1f-81ec-48fb-8a70-280f468cc78f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.157408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6263b1f-81ec-48fb-8a70-280f468cc78f None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.158060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6263b1f-81ec-48fb-8a70-280f468cc78f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:43.158365 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6263b1f-81ec-48fb-8a70-280f468cc78f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.160127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6263b1f-81ec-48fb-8a70-280f468cc78f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.177136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 328/653] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:43.177997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6263b1f-81ec-48fb-8a70-280f468cc78f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.202204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:43.235086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:43.243905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c11f8-7f04-4aa9-9599-ee19a0539f1e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.286669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372760c-096b-4a3e-b6be-3a7320664920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.287723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372760c-096b-4a3e-b6be-3a7320664920 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.288167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372760c-096b-4a3e-b6be-3a7320664920 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.288586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372760c-096b-4a3e-b6be-3a7320664920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.301813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372760c-096b-4a3e-b6be-3a7320664920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.303595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372760c-096b-4a3e-b6be-3a7320664920 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.318210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6263b1f-81ec-48fb-8a70-280f468cc78f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-0372760c-096b-4a3e-b6be-3a7320664920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:43.319969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:43.321100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:43.322273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:43.322273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:43.322273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:43.324077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 326/654] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:43.325158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372760c-096b-4a3e-b6be-3a7320664920 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.363663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f4fe-1ddd-42e7-b68d-1e2ba6705f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.364306 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f4fe-1ddd-42e7-b68d-1e2ba6705f5a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.364585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f4fe-1ddd-42e7-b68d-1e2ba6705f5a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.364856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f4fe-1ddd-42e7-b68d-1e2ba6705f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.379687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8f4fe-1ddd-42e7-b68d-1e2ba6705f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.381400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8f4fe-1ddd-42e7-b68d-1e2ba6705f5a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-4cc8f4fe-1ddd-42e7-b68d-1e2ba6705f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:43.401505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:43.402548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:43.403526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:43.403526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:43.403526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:43.403526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 329/655] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:43.403526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f4fe-1ddd-42e7-b68d-1e2ba6705f5a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.453878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372760c-096b-4a3e-b6be-3a7320664920 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.477677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:43.501769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72fd17-8107-480b-afc6-7ea0af56ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.502947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72fd17-8107-480b-afc6-7ea0af56ea94 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.503580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72fd17-8107-480b-afc6-7ea0af56ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.503858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72fd17-8107-480b-afc6-7ea0af56ea94 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.510551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:43.517818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72fd17-8107-480b-afc6-7ea0af56ea94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.519809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72fd17-8107-480b-afc6-7ea0af56ea94 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.520672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f4fe-1ddd-42e7-b68d-1e2ba6705f5a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-dc72fd17-8107-480b-afc6-7ea0af56ea94 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:43.532305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:43.533275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 19:40:43.534954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:43.541847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 327/656] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:43.542942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72fd17-8107-480b-afc6-7ea0af56ea94 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.558316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952ee15-3643-4122-8c80-7ea63df76082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.559045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952ee15-3643-4122-8c80-7ea63df76082 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.559371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952ee15-3643-4122-8c80-7ea63df76082 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.559646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952ee15-3643-4122-8c80-7ea63df76082 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.560404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952ee15-3643-4122-8c80-7ea63df76082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:43.560651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952ee15-3643-4122-8c80-7ea63df76082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.562083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952ee15-3643-4122-8c80-7ea63df76082 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.575910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 330/657] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:43.576905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952ee15-3643-4122-8c80-7ea63df76082 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.657690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72fd17-8107-480b-afc6-7ea0af56ea94 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.682536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952ee15-3643-4122-8c80-7ea63df76082 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.694891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca6cb-09ac-4b24-80e9-7ab0cadbafc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.695864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca6cb-09ac-4b24-80e9-7ab0cadbafc0 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.696375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca6cb-09ac-4b24-80e9-7ab0cadbafc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.696868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca6cb-09ac-4b24-80e9-7ab0cadbafc0 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.697716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca6cb-09ac-4b24-80e9-7ab0cadbafc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:43.698222 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca6cb-09ac-4b24-80e9-7ab0cadbafc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.699855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca6cb-09ac-4b24-80e9-7ab0cadbafc0 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.713543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 328/658] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:43.714730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca6cb-09ac-4b24-80e9-7ab0cadbafc0 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.718818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9c681-28aa-46e2-937a-3b29662ba65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.720002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9c681-28aa-46e2-937a-3b29662ba65b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.720002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9c681-28aa-46e2-937a-3b29662ba65b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.720199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9c681-28aa-46e2-937a-3b29662ba65b None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.720825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9c681-28aa-46e2-937a-3b29662ba65b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:43.721261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9c681-28aa-46e2-937a-3b29662ba65b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.722715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9c681-28aa-46e2-937a-3b29662ba65b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.746479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 331/659] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:43.746479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9c681-28aa-46e2-937a-3b29662ba65b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.758883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:43.762488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:43.832608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca6cb-09ac-4b24-80e9-7ab0cadbafc0 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.853882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9c681-28aa-46e2-937a-3b29662ba65b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:43.868089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84764c6-6338-4fc0-911c-cbf2cf89c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.868718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84764c6-6338-4fc0-911c-cbf2cf89c547 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.868997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84764c6-6338-4fc0-911c-cbf2cf89c547 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.869270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84764c6-6338-4fc0-911c-cbf2cf89c547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.876439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84764c6-6338-4fc0-911c-cbf2cf89c547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.877911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84764c6-6338-4fc0-911c-cbf2cf89c547 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.889664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7c931-92da-422f-9581-c72d9f8ed988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:43.890280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c931-92da-422f-9581-c72d9f8ed988 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.890557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c931-92da-422f-9581-c72d9f8ed988 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-a84764c6-6338-4fc0-911c-cbf2cf89c547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:43.890719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:43.891862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:43.892735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:43.892735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:43.892735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:43.892735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:43.892735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:43.892735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:43.892735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:43.892735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:43.893841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c931-92da-422f-9581-c72d9f8ed988 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.897287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 329/660] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:43.898017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84764c6-6338-4fc0-911c-cbf2cf89c547 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.901796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7c931-92da-422f-9581-c72d9f8ed988 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:43.903369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7c931-92da-422f-9581-c72d9f8ed988 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-4df7c931-92da-422f-9581-c72d9f8ed988 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:43.916557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:43.917555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:43.918544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 332/661] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:43.919154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ab30-bf0c-4f50-8340-54d66c2573f1 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:43.919154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ab30-bf0c-4f50-8340-54d66c2573f1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:43.919403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ab30-bf0c-4f50-8340-54d66c2573f1 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:43.923619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 333/662] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:43.923619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ab30-bf0c-4f50-8340-54d66c2573f1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:43.995972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:44.005741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:44.011510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84764c6-6338-4fc0-911c-cbf2cf89c547 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:44.035847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75ab30-bf0c-4f50-8340-54d66c2573f1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:44.046225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6e76d-7557-4b88-a838-7b0a1e2f768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:44.047053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6e76d-7557-4b88-a838-7b0a1e2f768c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:44.047532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6e76d-7557-4b88-a838-7b0a1e2f768c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:44.048008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6e76d-7557-4b88-a838-7b0a1e2f768c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:44.074040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98403b3-857d-477a-acf1-c9dba34da004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:44.074966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98403b3-857d-477a-acf1-c9dba34da004 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:44.075455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98403b3-857d-477a-acf1-c9dba34da004 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:44.075907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98403b3-857d-477a-acf1-c9dba34da004 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:44.076908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98403b3-857d-477a-acf1-c9dba34da004 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:44.077497 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98403b3-857d-477a-acf1-c9dba34da004 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:44.079106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98403b3-857d-477a-acf1-c9dba34da004 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:44.092987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 334/663] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:44.094188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98403b3-857d-477a-acf1-c9dba34da004 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:44.126958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6e76d-7557-4b88-a838-7b0a1e2f768c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:44.129127 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6e76d-7557-4b88-a838-7b0a1e2f768c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:44.202902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98403b3-857d-477a-acf1-c9dba34da004 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:44.233845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:44.234136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:44.242910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 330/664] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:44.245642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6af7b-92ce-4881-a731-8f23efce0751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:44.245642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6af7b-92ce-4881-a731-8f23efce0751 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:44.245642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6af7b-92ce-4881-a731-8f23efce0751 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:44.245923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdad1f-c94f-41bb-8cb0-2f90332d6d65 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:44.246041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6af7b-92ce-4881-a731-8f23efce0751 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:44.246131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdad1f-c94f-41bb-8cb0-2f90332d6d65 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:44.246131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdad1f-c94f-41bb-8cb0-2f90332d6d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:44.246282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6af7b-92ce-4881-a731-8f23efce0751 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:44.246282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6af7b-92ce-4881-a731-8f23efce0751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:44.246795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6af7b-92ce-4881-a731-8f23efce0751 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:44.264995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e1bdad1f-c94f-41bb-8cb0-2f90332d6d65 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:44.265316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 335/665] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Aug 22 19:40:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:44.270479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6af7b-92ce-4881-a731-8f23efce0751 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:44.270611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e1bdad1f-c94f-41bb-8cb0-2f90332d6d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:44.351249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 331/666] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:44.351249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdad1f-c94f-41bb-8cb0-2f90332d6d65 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:44.380206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6af7b-92ce-4881-a731-8f23efce0751 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:44.435561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22653f8-30fa-4cf1-b1a2-86f6e4112b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:44.436158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22653f8-30fa-4cf1-b1a2-86f6e4112b2c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:44.436631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22653f8-30fa-4cf1-b1a2-86f6e4112b2c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:44.436912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22653f8-30fa-4cf1-b1a2-86f6e4112b2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:44.437672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22653f8-30fa-4cf1-b1a2-86f6e4112b2c None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=2422c781c74f44ae83e8b094f1728743) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:44.437971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22653f8-30fa-4cf1-b1a2-86f6e4112b2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:44.439434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22653f8-30fa-4cf1-b1a2-86f6e4112b2c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:44.451560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 336/667] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:44 2022] GET /identity/v3/role_assignments?user.id=2422c781c74f44ae83e8b094f1728743&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:44.452493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22653f8-30fa-4cf1-b1a2-86f6e4112b2c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:44.494337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdad1f-c94f-41bb-8cb0-2f90332d6d65 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:44.529936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:44.543090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359220d-dbca-476f-850f-ae8b9631a90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:44.547487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359220d-dbca-476f-850f-ae8b9631a90d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:44.547487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359220d-dbca-476f-850f-ae8b9631a90d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:44.547487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359220d-dbca-476f-850f-ae8b9631a90d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:44.570619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359220d-dbca-476f-850f-ae8b9631a90d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:44.572183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359220d-dbca-476f-850f-ae8b9631a90d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:44.586639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-c359220d-dbca-476f-850f-ae8b9631a90d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:44.596193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:44.599442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:44.600358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:44.600358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:44.600358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:44.600358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 332/668] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:44.604254 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359220d-dbca-476f-850f-ae8b9631a90d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:44.681115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22653f8-30fa-4cf1-b1a2-86f6e4112b2c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:44.721717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62723452-22f0-4016-a9cb-1863356476ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:44.722364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62723452-22f0-4016-a9cb-1863356476ef None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:44.722641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62723452-22f0-4016-a9cb-1863356476ef None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:44.722913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62723452-22f0-4016-a9cb-1863356476ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:44.747079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359220d-dbca-476f-850f-ae8b9631a90d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:44.793720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04530b43-2f4a-430e-a883-386b05ee63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:44.794255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04530b43-2f4a-430e-a883-386b05ee63d3 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:44.794531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04530b43-2f4a-430e-a883-386b05ee63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:44.794804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04530b43-2f4a-430e-a883-386b05ee63d3 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:44.795477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04530b43-2f4a-430e-a883-386b05ee63d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:44.795790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04530b43-2f4a-430e-a883-386b05ee63d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:44.797836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04530b43-2f4a-430e-a883-386b05ee63d3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:44.799262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62723452-22f0-4016-a9cb-1863356476ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:44.801403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62723452-22f0-4016-a9cb-1863356476ef None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:44.813937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 333/669] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:44.815005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04530b43-2f4a-430e-a883-386b05ee63d3 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:44.859713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:44.863302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:44.934174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 337/670] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:44.934174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62723452-22f0-4016-a9cb-1863356476ef None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:44.940450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04530b43-2f4a-430e-a883-386b05ee63d3 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:44.980630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38b197-f5ec-41f9-a051-8493ce7738a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:44.981296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38b197-f5ec-41f9-a051-8493ce7738a5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:44.981574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38b197-f5ec-41f9-a051-8493ce7738a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:44.981847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38b197-f5ec-41f9-a051-8493ce7738a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:44.994404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38b197-f5ec-41f9-a051-8493ce7738a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-4c38b197-f5ec-41f9-a051-8493ce7738a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:44.999531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:45.000460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:45.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:45.006551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 334/671] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:45.007573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38b197-f5ec-41f9-a051-8493ce7738a5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.065572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62723452-22f0-4016-a9cb-1863356476ef None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:45.103601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ad969-b417-49b0-81c3-c4b32368bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:45.104233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad969-b417-49b0-81c3-c4b32368bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.104519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad969-b417-49b0-81c3-c4b32368bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.104784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ad969-b417-49b0-81c3-c4b32368bcf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.111476 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ad969-b417-49b0-81c3-c4b32368bcf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:45.113620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ad969-b417-49b0-81c3-c4b32368bcf5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:45.120005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:45.123788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38b197-f5ec-41f9-a051-8493ce7738a5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-3f2ad969-b417-49b0-81c3-c4b32368bcf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:45.124824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:45.125676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 338/672] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:45.126661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ad969-b417-49b0-81c3-c4b32368bcf5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.140231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:45.166816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d3230-a5bc-4cb2-9746-33f26089185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:45.167485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3230-a5bc-4cb2-9746-33f26089185e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.167767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3230-a5bc-4cb2-9746-33f26089185e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.168039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d3230-a5bc-4cb2-9746-33f26089185e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.179020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d3230-a5bc-4cb2-9746-33f26089185e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:45.180611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d3230-a5bc-4cb2-9746-33f26089185e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-c41d3230-a5bc-4cb2-9746-33f26089185e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:45.196815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:45.197797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:45.198697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:45.198697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:45.198697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:45.198697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 335/673] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:45.199420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a2f81-2364-4ce4-bd34-35b7259561be None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.199420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a2f81-2364-4ce4-bd34-35b7259561be None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.199668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a2f81-2364-4ce4-bd34-35b7259561be None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.203358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 336/674] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:45.203358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a2f81-2364-4ce4-bd34-35b7259561be None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.239978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ad969-b417-49b0-81c3-c4b32368bcf5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:45.277342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e1335-4d95-48a8-8068-3d122c10c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:45.278283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e1335-4d95-48a8-8068-3d122c10c113 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.278966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e1335-4d95-48a8-8068-3d122c10c113 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.278966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e1335-4d95-48a8-8068-3d122c10c113 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.279534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e1335-4d95-48a8-8068-3d122c10c113 None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:45.279824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e1335-4d95-48a8-8068-3d122c10c113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:45.281194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e1335-4d95-48a8-8068-3d122c10c113 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:45.295347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 339/675] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:45.295347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e1335-4d95-48a8-8068-3d122c10c113 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.323754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a2f81-2364-4ce4-bd34-35b7259561be None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:45.361522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feacad9-1907-48e8-8167-878249fc3a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:45.362263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feacad9-1907-48e8-8167-878249fc3a91 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.362488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feacad9-1907-48e8-8167-878249fc3a91 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.362762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feacad9-1907-48e8-8167-878249fc3a91 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.363484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feacad9-1907-48e8-8167-878249fc3a91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:45.363790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feacad9-1907-48e8-8167-878249fc3a91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:45.365231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feacad9-1907-48e8-8167-878249fc3a91 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:45.370194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:45.378846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 337/676] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:45.380351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61cac4-680e-44ce-93b5-731847a582bf None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.380634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61cac4-680e-44ce-93b5-731847a582bf None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.380906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61cac4-680e-44ce-93b5-731847a582bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.399458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4e61cac4-680e-44ce-93b5-731847a582bf None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:45.400719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4e61cac4-680e-44ce-93b5-731847a582bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:45.404037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:45.411264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e1335-4d95-48a8-8068-3d122c10c113 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:45.449405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fda7a-b3e3-41fe-8a68-a17d6abace0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:45.450015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fda7a-b3e3-41fe-8a68-a17d6abace0b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.450323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fda7a-b3e3-41fe-8a68-a17d6abace0b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.450567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fda7a-b3e3-41fe-8a68-a17d6abace0b None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.451217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fda7a-b3e3-41fe-8a68-a17d6abace0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:45.451547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fda7a-b3e3-41fe-8a68-a17d6abace0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:45.452928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fda7a-b3e3-41fe-8a68-a17d6abace0b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:45.465473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 340/677] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:45.470684 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fda7a-b3e3-41fe-8a68-a17d6abace0b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.483523 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 338/678] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:45.484298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61cac4-680e-44ce-93b5-731847a582bf None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.594802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fda7a-b3e3-41fe-8a68-a17d6abace0b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:45.611871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61cac4-680e-44ce-93b5-731847a582bf None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:45.638887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:45.646191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392819-6d37-40fd-97be-1d594bc04b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:45.647185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392819-6d37-40fd-97be-1d594bc04b4f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.648002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392819-6d37-40fd-97be-1d594bc04b4f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.648376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5392819-6d37-40fd-97be-1d594bc04b4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.657273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284d3ca-449a-43be-b4e3-de1a86f71f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:45.659115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284d3ca-449a-43be-b4e3-de1a86f71f33 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.659583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284d3ca-449a-43be-b4e3-de1a86f71f33 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.660026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284d3ca-449a-43be-b4e3-de1a86f71f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.660955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284d3ca-449a-43be-b4e3-de1a86f71f33 None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=4414630bb2da4523906f0b2dee0c4c4f) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:45.661178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5392819-6d37-40fd-97be-1d594bc04b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:45.661626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284d3ca-449a-43be-b4e3-de1a86f71f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:45.662884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5392819-6d37-40fd-97be-1d594bc04b4f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:45.663642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284d3ca-449a-43be-b4e3-de1a86f71f33 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:45.671019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 339/679] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/role_assignments?user.id=4414630bb2da4523906f0b2dee0c4c4f&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:45.672238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284d3ca-449a-43be-b4e3-de1a86f71f33 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.678449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-a5392819-6d37-40fd-97be-1d594bc04b4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:45.688012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:45.692155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:45.693043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:45.693043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:45.693043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:45.693043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 341/680] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:45.696732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392819-6d37-40fd-97be-1d594bc04b4f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.838964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5392819-6d37-40fd-97be-1d594bc04b4f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:45.852049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284d3ca-449a-43be-b4e3-de1a86f71f33 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:45.882697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc257b-ad9a-43c3-ad66-a94909871ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:45.883419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc257b-ad9a-43c3-ad66-a94909871ea6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.883621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc257b-ad9a-43c3-ad66-a94909871ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.885893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc257b-ad9a-43c3-ad66-a94909871ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.885893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc257b-ad9a-43c3-ad66-a94909871ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:45.885893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc257b-ad9a-43c3-ad66-a94909871ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:45.886387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc257b-ad9a-43c3-ad66-a94909871ea6 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:45.902399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 342/681] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:45.903416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc257b-ad9a-43c3-ad66-a94909871ea6 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.903873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5fa88-2a71-4b82-a802-07bc2c85a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:45.904623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5fa88-2a71-4b82-a802-07bc2c85a4ac None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:45.904896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5fa88-2a71-4b82-a802-07bc2c85a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:45.905163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5fa88-2a71-4b82-a802-07bc2c85a4ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:45.915911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5fa88-2a71-4b82-a802-07bc2c85a4ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:45.917371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5fa88-2a71-4b82-a802-07bc2c85a4ac None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-89f5fa88-2a71-4b82-a802-07bc2c85a4ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:45.937234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:45.938301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:45.941391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:45.941391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:45.941391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:45.941391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:45.941391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:45.941391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:45.941391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:45.941391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:45.941391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 340/682] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:45.941955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5fa88-2a71-4b82-a802-07bc2c85a4ac None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:45.974541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:46.014377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:46.032224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc257b-ad9a-43c3-ad66-a94909871ea6 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:46.054338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5fa88-2a71-4b82-a802-07bc2c85a4ac None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:46.068756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c29b16-2127-4f50-88f5-d52d3fdb193f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:46.069679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c29b16-2127-4f50-88f5-d52d3fdb193f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.070117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c29b16-2127-4f50-88f5-d52d3fdb193f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.070606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c29b16-2127-4f50-88f5-d52d3fdb193f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.081617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c29b16-2127-4f50-88f5-d52d3fdb193f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-09c29b16-2127-4f50-88f5-d52d3fdb193f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:46.086788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:46.087815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:46.088637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:46.090478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2fbaf-df5e-4291-a9be-d12bd3fe036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:46.091109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2fbaf-df5e-4291-a9be-d12bd3fe036b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.091485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2fbaf-df5e-4291-a9be-d12bd3fe036b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.091681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2fbaf-df5e-4291-a9be-d12bd3fe036b None admin] PATH_INFO: `/v3/users/swift` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.092105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 343/683] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:46.093169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c29b16-2127-4f50-88f5-d52d3fdb193f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:46.100460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2fbaf-df5e-4291-a9be-d12bd3fe036b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:46.101912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2fbaf-df5e-4291-a9be-d12bd3fe036b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-c5c2fbaf-df5e-4291-a9be-d12bd3fe036b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:46.114521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:46.115551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:46.116512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 341/684] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:46.117141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2fbaf-df5e-4291-a9be-d12bd3fe036b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:46.202563 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c29b16-2127-4f50-88f5-d52d3fdb193f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:46.219699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2fbaf-df5e-4291-a9be-d12bd3fe036b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:46.239454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efe830-58df-40bb-94a7-4327700487c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:46.240458 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efe830-58df-40bb-94a7-4327700487c5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.240934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efe830-58df-40bb-94a7-4327700487c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.241410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efe830-58df-40bb-94a7-4327700487c5 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.242368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efe830-58df-40bb-94a7-4327700487c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:46.242878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efe830-58df-40bb-94a7-4327700487c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:46.244561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efe830-58df-40bb-94a7-4327700487c5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:46.256266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205593-60e2-4642-b39f-9c96ad2de5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:46.256878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205593-60e2-4642-b39f-9c96ad2de5ba None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.257155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205593-60e2-4642-b39f-9c96ad2de5ba None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.257422 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205593-60e2-4642-b39f-9c96ad2de5ba None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.258098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10205593-60e2-4642-b39f-9c96ad2de5ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:46.258394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10205593-60e2-4642-b39f-9c96ad2de5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:46.260070 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10205593-60e2-4642-b39f-9c96ad2de5ba None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:46.260307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 344/685] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:46.261336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efe830-58df-40bb-94a7-4327700487c5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:46.264845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:46.274292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 342/686] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:46.278787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205593-60e2-4642-b39f-9c96ad2de5ba None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:46.309030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:46.372827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efe830-58df-40bb-94a7-4327700487c5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:46.390530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205593-60e2-4642-b39f-9c96ad2de5ba None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:46.409589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03df692-c9cb-402e-a217-bc90c8f0fb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:46.410175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03df692-c9cb-402e-a217-bc90c8f0fb65 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.410418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03df692-c9cb-402e-a217-bc90c8f0fb65 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.410687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03df692-c9cb-402e-a217-bc90c8f0fb65 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.411506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03df692-c9cb-402e-a217-bc90c8f0fb65 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:46.411849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03df692-c9cb-402e-a217-bc90c8f0fb65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:46.413305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03df692-c9cb-402e-a217-bc90c8f0fb65 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:46.432545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 345/687] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 19:40:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:46.433456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03df692-c9cb-402e-a217-bc90c8f0fb65 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:46.446076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1152a4a-55da-4c18-9ca4-27daa39f2b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:46.446076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1152a4a-55da-4c18-9ca4-27daa39f2b39 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.446076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1152a4a-55da-4c18-9ca4-27daa39f2b39 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.446076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1152a4a-55da-4c18-9ca4-27daa39f2b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.446491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1152a4a-55da-4c18-9ca4-27daa39f2b39 None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=7500529eff574ca6ae3a9a77d72d2a40) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:46.446491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1152a4a-55da-4c18-9ca4-27daa39f2b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:46.446491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1152a4a-55da-4c18-9ca4-27daa39f2b39 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:46.451993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 343/688] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:46 2022] GET /identity/v3/role_assignments?user.id=7500529eff574ca6ae3a9a77d72d2a40&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:46.452976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1152a4a-55da-4c18-9ca4-27daa39f2b39 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:46.460446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:46.522259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:46.582112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1152a4a-55da-4c18-9ca4-27daa39f2b39 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:46.634241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ebdcf-6bff-4bfa-a204-7d299ba4f1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:46.634845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ebdcf-6bff-4bfa-a204-7d299ba4f1c4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.634845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ebdcf-6bff-4bfa-a204-7d299ba4f1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.635116 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ebdcf-6bff-4bfa-a204-7d299ba4f1c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.641322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03df692-c9cb-402e-a217-bc90c8f0fb65 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:46.680382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb3391-3045-4039-b959-3c26c1b0ccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:46.681015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb3391-3045-4039-b959-3c26c1b0ccf1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.681292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb3391-3045-4039-b959-3c26c1b0ccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.681554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb3391-3045-4039-b959-3c26c1b0ccf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.692714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb3391-3045-4039-b959-3c26c1b0ccf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:46.694177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb3391-3045-4039-b959-3c26c1b0ccf1 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-bbeb3391-3045-4039-b959-3c26c1b0ccf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:46.709788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:46.710800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:46.711760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:46.711760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:46.711760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:46.711760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 346/689] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:46.711760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3113a-f2f1-4f7e-9aa6-5f2251a2574d None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.712057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3113a-f2f1-4f7e-9aa6-5f2251a2574d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.712283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3113a-f2f1-4f7e-9aa6-5f2251a2574d None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.713747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 347/690] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:46.718743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ebdcf-6bff-4bfa-a204-7d299ba4f1c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:46.718743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ebdcf-6bff-4bfa-a204-7d299ba4f1c4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:46.720317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eb036-debc-4962-a662-d8228be03de9 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:46.720597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eb036-debc-4962-a662-d8228be03de9 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:46.720866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eb036-debc-4962-a662-d8228be03de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:46.740323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-fb4eb036-debc-4962-a662-d8228be03de9 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:46.741520 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fb4eb036-debc-4962-a662-d8228be03de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:46.782797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:46.827388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 348/691] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:46.828278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eb036-debc-4962-a662-d8228be03de9 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:46.837031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:46.860859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 344/692] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:46.862914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ebdcf-6bff-4bfa-a204-7d299ba4f1c4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:47.031319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eb036-debc-4962-a662-d8228be03de9 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.036038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ebdcf-6bff-4bfa-a204-7d299ba4f1c4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.098410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66cf4c-b0a5-43a0-b35e-bdd845bd23a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.099025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66cf4c-b0a5-43a0-b35e-bdd845bd23a1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.099322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66cf4c-b0a5-43a0-b35e-bdd845bd23a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.099600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66cf4c-b0a5-43a0-b35e-bdd845bd23a1 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.100255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66cf4c-b0a5-43a0-b35e-bdd845bd23a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:47.100555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66cf4c-b0a5-43a0-b35e-bdd845bd23a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.101923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66cf4c-b0a5-43a0-b35e-bdd845bd23a1 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.103839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56037b1-1429-4553-bb76-b744a0e3e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.104565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56037b1-1429-4553-bb76-b744a0e3e9ed None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.104841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56037b1-1429-4553-bb76-b744a0e3e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.105109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56037b1-1429-4553-bb76-b744a0e3e9ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.123158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56037b1-1429-4553-bb76-b744a0e3e9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.126902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56037b1-1429-4553-bb76-b744a0e3e9ed None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.127990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 349/693] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:47.129107 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66cf4c-b0a5-43a0-b35e-bdd845bd23a1 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-b56037b1-1429-4553-bb76-b744a0e3e9ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:47.146389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:47.147526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:47.148426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:47.148426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:47.148426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:47.148426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 345/694] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:47.148657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56037b1-1429-4553-bb76-b744a0e3e9ed None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:47.156089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:47.215871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:47.267729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56037b1-1429-4553-bb76-b744a0e3e9ed None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.268197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66cf4c-b0a5-43a0-b35e-bdd845bd23a1 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.306179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615724c-fb7a-426b-b202-f587ddc45cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.307193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615724c-fb7a-426b-b202-f587ddc45cd6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.307725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615724c-fb7a-426b-b202-f587ddc45cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.308317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615724c-fb7a-426b-b202-f587ddc45cd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.314999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85fb7f-6bdc-4347-b647-571aa83f0d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.316000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85fb7f-6bdc-4347-b647-571aa83f0d9d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.316500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85fb7f-6bdc-4347-b647-571aa83f0d9d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.316989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85fb7f-6bdc-4347-b647-571aa83f0d9d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.317785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85fb7f-6bdc-4347-b647-571aa83f0d9d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.319402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85fb7f-6bdc-4347-b647-571aa83f0d9d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.321554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615724c-fb7a-426b-b202-f587ddc45cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.323128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615724c-fb7a-426b-b202-f587ddc45cd6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-bb85fb7f-6bdc-4347-b647-571aa83f0d9d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:47.333100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:47.334166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 19:40:47.335011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-2615724c-fb7a-426b-b202-f587ddc45cd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:47.336317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:47.337626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 346/695] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 19:40:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:47.338576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615724c-fb7a-426b-b202-f587ddc45cd6 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:47.347702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 350/696] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Aug 22 19:40:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:47.347702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85fb7f-6bdc-4347-b647-571aa83f0d9d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:47.422371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:47.468668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615724c-fb7a-426b-b202-f587ddc45cd6 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.487305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85fb7f-6bdc-4347-b647-571aa83f0d9d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.515779 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:47.517360 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4316d0a-5b23-436d-9324-e1c1e9383db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.519217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4316d0a-5b23-436d-9324-e1c1e9383db7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.519895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4316d0a-5b23-436d-9324-e1c1e9383db7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.520636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4316d0a-5b23-436d-9324-e1c1e9383db7 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.521783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4316d0a-5b23-436d-9324-e1c1e9383db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:47.522238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4316d0a-5b23-436d-9324-e1c1e9383db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.523823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4316d0a-5b23-436d-9324-e1c1e9383db7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.527331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b45c0-79aa-4655-a242-0df96a94cbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.527331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b45c0-79aa-4655-a242-0df96a94cbed None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.527331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b45c0-79aa-4655-a242-0df96a94cbed None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.527331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b45c0-79aa-4655-a242-0df96a94cbed None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.527919 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b45c0-79aa-4655-a242-0df96a94cbed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:47.528387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b45c0-79aa-4655-a242-0df96a94cbed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.529920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b45c0-79aa-4655-a242-0df96a94cbed None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.540826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 347/697] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:47.541902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4316d0a-5b23-436d-9324-e1c1e9383db7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:47.556582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 351/698] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 19:40:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:47.557592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b45c0-79aa-4655-a242-0df96a94cbed None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:47.661093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4316d0a-5b23-436d-9324-e1c1e9383db7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.685931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:47.698092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b45c0-79aa-4655-a242-0df96a94cbed None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.698602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787567d-b31d-4aae-ba2c-c4cb4503f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.699414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787567d-b31d-4aae-ba2c-c4cb4503f51a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.699790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787567d-b31d-4aae-ba2c-c4cb4503f51a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.700158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787567d-b31d-4aae-ba2c-c4cb4503f51a None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.701008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787567d-b31d-4aae-ba2c-c4cb4503f51a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:47.701406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787567d-b31d-4aae-ba2c-c4cb4503f51a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.703119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787567d-b31d-4aae-ba2c-c4cb4503f51a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.713260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 348/699] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 19:40:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:47.713260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787567d-b31d-4aae-ba2c-c4cb4503f51a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:47.759155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559dab3-c6aa-421a-a99b-a7a78be10136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.760093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559dab3-c6aa-421a-a99b-a7a78be10136 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.760538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559dab3-c6aa-421a-a99b-a7a78be10136 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.761429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559dab3-c6aa-421a-a99b-a7a78be10136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.771373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559dab3-c6aa-421a-a99b-a7a78be10136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.773566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559dab3-c6aa-421a-a99b-a7a78be10136 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-e559dab3-c6aa-421a-a99b-a7a78be10136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:47.790350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:47.791465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:47.792603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:47.792603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:47.792603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:47.792603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:47.792603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:47.792603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:47.792603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:47.792603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:47.794874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 352/700] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:47.795824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559dab3-c6aa-421a-a99b-a7a78be10136 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:47.834382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787567d-b31d-4aae-ba2c-c4cb4503f51a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.858468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:47.875009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81347c2e-86ca-4a6e-89f0-78a6b623a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.876055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81347c2e-86ca-4a6e-89f0-78a6b623a185 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.876726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81347c2e-86ca-4a6e-89f0-78a6b623a185 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.877251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81347c2e-86ca-4a6e-89f0-78a6b623a185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.920592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559dab3-c6aa-421a-a99b-a7a78be10136 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:47.939737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:47.953115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81347c2e-86ca-4a6e-89f0-78a6b623a185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.954582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81347c2e-86ca-4a6e-89f0-78a6b623a185 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.959379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b54d1-2838-4cdf-b98e-77d1806639cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:47.960165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b54d1-2838-4cdf-b98e-77d1806639cf None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:47.960694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b54d1-2838-4cdf-b98e-77d1806639cf None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:47.961127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b54d1-2838-4cdf-b98e-77d1806639cf None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:47.961918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b54d1-2838-4cdf-b98e-77d1806639cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:47.962404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b54d1-2838-4cdf-b98e-77d1806639cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:47.963799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b54d1-2838-4cdf-b98e-77d1806639cf None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:47.977349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 353/701] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 19:40:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:47.977349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b54d1-2838-4cdf-b98e-77d1806639cf None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:48.081098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 349/702] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:48.082989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22a7e-d12d-40f7-81e9-a78563cd7da6 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.084125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22a7e-d12d-40f7-81e9-a78563cd7da6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.084535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d22a7e-d12d-40f7-81e9-a78563cd7da6 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.087972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 350/703] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:48.088856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22a7e-d12d-40f7-81e9-a78563cd7da6 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:48.129895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b54d1-2838-4cdf-b98e-77d1806639cf None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:48.145068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:48.183581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb01aa-b7fe-4631-843b-b31251122f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:48.184207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb01aa-b7fe-4631-843b-b31251122f44 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.184486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb01aa-b7fe-4631-843b-b31251122f44 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.184806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb01aa-b7fe-4631-843b-b31251122f44 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.185811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb01aa-b7fe-4631-843b-b31251122f44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:48.186153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb01aa-b7fe-4631-843b-b31251122f44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:48.188902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb01aa-b7fe-4631-843b-b31251122f44 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:48.205082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 354/704] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:48.207085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913a44d-b47a-4b93-925b-ef6ee7f17a0a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.211435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913a44d-b47a-4b93-925b-ef6ee7f17a0a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.211990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913a44d-b47a-4b93-925b-ef6ee7f17a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.216545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:48.235426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d22a7e-d12d-40f7-81e9-a78563cd7da6 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:48.239377 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f913a44d-b47a-4b93-925b-ef6ee7f17a0a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:48.240624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f913a44d-b47a-4b93-925b-ef6ee7f17a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:48.281596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17172946-685f-412a-935c-8e246818e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:48.282237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17172946-685f-412a-935c-8e246818e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.282688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17172946-685f-412a-935c-8e246818e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.283064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17172946-685f-412a-935c-8e246818e7f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.297515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17172946-685f-412a-935c-8e246818e7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:48.299001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17172946-685f-412a-935c-8e246818e7f4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-17172946-685f-412a-935c-8e246818e7f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:48.320386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:48.321478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:48.322372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:48.322372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:48.322372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:48.322542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 351/705] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:48.323956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17172946-685f-412a-935c-8e246818e7f4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:48.335363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 355/706] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:48.336164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913a44d-b47a-4b93-925b-ef6ee7f17a0a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:48.475064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17172946-685f-412a-935c-8e246818e7f4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:48.490731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:48.494242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913a44d-b47a-4b93-925b-ef6ee7f17a0a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:48.511741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917702b6-99ba-499f-98a2-a32f4e176b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:48.512371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917702b6-99ba-499f-98a2-a32f4e176b80 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.512881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917702b6-99ba-499f-98a2-a32f4e176b80 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.513159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917702b6-99ba-499f-98a2-a32f4e176b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.513895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917702b6-99ba-499f-98a2-a32f4e176b80 None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=5a1eeb59bfa24e4bb6658aa4bb5f7852) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:48.514200 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917702b6-99ba-499f-98a2-a32f4e176b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:48.516131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917702b6-99ba-499f-98a2-a32f4e176b80 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:48.524504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 352/707] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:48 2022] GET /identity/v3/role_assignments?user.id=5a1eeb59bfa24e4bb6658aa4bb5f7852&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:48.536293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3cb6a-c0df-4e98-ae2c-895645f5141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:48.537030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3cb6a-c0df-4e98-ae2c-895645f5141a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.537400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3cb6a-c0df-4e98-ae2c-895645f5141a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.537746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3cb6a-c0df-4e98-ae2c-895645f5141a None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.538525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3cb6a-c0df-4e98-ae2c-895645f5141a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:48.538893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3cb6a-c0df-4e98-ae2c-895645f5141a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:48.543541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3cb6a-c0df-4e98-ae2c-895645f5141a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:48.555961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 356/708] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:48.564555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917702b6-99ba-499f-98a2-a32f4e176b80 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:48.564555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:48.678203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917702b6-99ba-499f-98a2-a32f4e176b80 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:48.707168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccde670-b0f1-4099-8168-bc9124aa3953 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.707742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccde670-b0f1-4099-8168-bc9124aa3953 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.707742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccde670-b0f1-4099-8168-bc9124aa3953 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.709327 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 357/709] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:48.714748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e7a58-9156-486a-8738-d4c1076abb8d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.715032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e7a58-9156-486a-8738-d4c1076abb8d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.715341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e7a58-9156-486a-8738-d4c1076abb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.716356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556fd50-edb3-49ab-a7af-75c1219765b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:48.716990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556fd50-edb3-49ab-a7af-75c1219765b0 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.717265 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556fd50-edb3-49ab-a7af-75c1219765b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.717534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556fd50-edb3-49ab-a7af-75c1219765b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.726134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556fd50-edb3-49ab-a7af-75c1219765b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:48.727790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556fd50-edb3-49ab-a7af-75c1219765b0 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:48.738471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-832e7a58-9156-486a-8738-d4c1076abb8d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:48.739737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-832e7a58-9156-486a-8738-d4c1076abb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-8556fd50-edb3-49ab-a7af-75c1219765b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:48.740332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:48.741229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 353/710] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:48.744346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556fd50-edb3-49ab-a7af-75c1219765b0 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:48.824082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:48.834499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 358/711] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:48.839811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e7a58-9156-486a-8738-d4c1076abb8d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:48.881295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556fd50-edb3-49ab-a7af-75c1219765b0 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:48.923061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6714c-b808-481c-b8a9-d0e1e382f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:48.923769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6714c-b808-481c-b8a9-d0e1e382f4b8 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:48.924082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6714c-b808-481c-b8a9-d0e1e382f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:48.924354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6714c-b808-481c-b8a9-d0e1e382f4b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:48.935838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6714c-b808-481c-b8a9-d0e1e382f4b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:48.937226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6714c-b808-481c-b8a9-d0e1e382f4b8 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-1dc6714c-b808-481c-b8a9-d0e1e382f4b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:48.951967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:48.953008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:48.953907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:48.953907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:48.953907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:48.959013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 354/712] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:48.959938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6714c-b808-481c-b8a9-d0e1e382f4b8 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:48.976774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:48.989706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e7a58-9156-486a-8738-d4c1076abb8d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:49.052358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849acb1d-33db-4436-955e-bf9f904afc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:49.052985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849acb1d-33db-4436-955e-bf9f904afc48 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:49.053266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849acb1d-33db-4436-955e-bf9f904afc48 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:49.053533 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849acb1d-33db-4436-955e-bf9f904afc48 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:49.054240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849acb1d-33db-4436-955e-bf9f904afc48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:49.054545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849acb1d-33db-4436-955e-bf9f904afc48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:49.059555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849acb1d-33db-4436-955e-bf9f904afc48 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:49.082208 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 359/713] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:49.088620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849acb1d-33db-4436-955e-bf9f904afc48 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:49.120200 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6714c-b808-481c-b8a9-d0e1e382f4b8 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:49.155592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:49.194832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea8a0a-96f6-4789-a6f5-b2c72fadb257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:49.195561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea8a0a-96f6-4789-a6f5-b2c72fadb257 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:49.195931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea8a0a-96f6-4789-a6f5-b2c72fadb257 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:49.196299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea8a0a-96f6-4789-a6f5-b2c72fadb257 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:49.197045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea8a0a-96f6-4789-a6f5-b2c72fadb257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:49.197448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea8a0a-96f6-4789-a6f5-b2c72fadb257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:49.198963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea8a0a-96f6-4789-a6f5-b2c72fadb257 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:49.215753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 355/714] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:49.216742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea8a0a-96f6-4789-a6f5-b2c72fadb257 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:49.241215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849acb1d-33db-4436-955e-bf9f904afc48 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:49.278701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712a40a-c6f2-4ea7-aff3-fa38d7530b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:49.279491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712a40a-c6f2-4ea7-aff3-fa38d7530b56 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:49.279864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712a40a-c6f2-4ea7-aff3-fa38d7530b56 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:49.280237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712a40a-c6f2-4ea7-aff3-fa38d7530b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:49.281056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712a40a-c6f2-4ea7-aff3-fa38d7530b56 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1787fcb6f7c34de59c9682a4d8c3d2a3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:49.281462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712a40a-c6f2-4ea7-aff3-fa38d7530b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:49.283002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712a40a-c6f2-4ea7-aff3-fa38d7530b56 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:49.295424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 360/715] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:49 2022] GET /identity/v3/role_assignments?user.id=1787fcb6f7c34de59c9682a4d8c3d2a3&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=9ec7f759c0a64655b794dfb597930076 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:49.296513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712a40a-c6f2-4ea7-aff3-fa38d7530b56 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:49.348332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea8a0a-96f6-4789-a6f5-b2c72fadb257 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:49.350882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:49.400439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefad04-35f0-4697-a421-15a20dc99d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:49.401104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefad04-35f0-4697-a421-15a20dc99d0d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:49.401383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefad04-35f0-4697-a421-15a20dc99d0d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:49.401657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefad04-35f0-4697-a421-15a20dc99d0d None admin] PATH_INFO: `/v3/services/network` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:49.402259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefad04-35f0-4697-a421-15a20dc99d0d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:49.410680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefad04-35f0-4697-a421-15a20dc99d0d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-eaefad04-35f0-4697-a421-15a20dc99d0d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:49.423257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:49.425475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:49.426695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 356/716] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:49 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:49.435250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefad04-35f0-4697-a421-15a20dc99d0d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:49.499614 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:49.546327 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712a40a-c6f2-4ea7-aff3-fa38d7530b56 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:49.623257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251dd8b-5e5c-4520-aaf6-6ec19674e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:49.623257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251dd8b-5e5c-4520-aaf6-6ec19674e587 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:49.623257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251dd8b-5e5c-4520-aaf6-6ec19674e587 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:49.623257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251dd8b-5e5c-4520-aaf6-6ec19674e587 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:49.624073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251dd8b-5e5c-4520-aaf6-6ec19674e587 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:49.624222 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefad04-35f0-4697-a421-15a20dc99d0d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:49.624744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251dd8b-5e5c-4520-aaf6-6ec19674e587 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:49.660761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ca4e-81fa-4415-963b-a10f7abe295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:49.661371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ca4e-81fa-4415-963b-a10f7abe295e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:49.661655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ca4e-81fa-4415-963b-a10f7abe295e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:49.661932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ca4e-81fa-4415-963b-a10f7abe295e None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:49.662568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ca4e-81fa-4415-963b-a10f7abe295e None admin] RBAC: Adding query filter params (name=network) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:49.662873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ca4e-81fa-4415-963b-a10f7abe295e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:49.664536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ca4e-81fa-4415-963b-a10f7abe295e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:49.669529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 357/717] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:40:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:49.675186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ca4e-81fa-4415-963b-a10f7abe295e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:49.726697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 361/718] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:40:49 2022] POST /identity/v3/users => generated 254 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:40:49.817032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ca4e-81fa-4415-963b-a10f7abe295e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:49.818591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:49.869450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5466bf-d7bc-4c74-861a-a05f5345bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:49.870077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5466bf-d7bc-4c74-861a-a05f5345bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:49.870354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5466bf-d7bc-4c74-861a-a05f5345bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:49.870620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5466bf-d7bc-4c74-861a-a05f5345bcd5 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:49.871291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5466bf-d7bc-4c74-861a-a05f5345bcd5 None admin] RBAC: Adding query filter params (type=network) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:49.871595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5466bf-d7bc-4c74-861a-a05f5345bcd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:49.873004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5466bf-d7bc-4c74-861a-a05f5345bcd5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:49.885032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 358/719] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:40:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:50.132688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e6ce-0f25-4afc-93a3-b15d68137dc5 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:50.133038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e6ce-0f25-4afc-93a3-b15d68137dc5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:50.133201 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621e6ce-0f25-4afc-93a3-b15d68137dc5 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:50.134778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 362/720] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:50.140555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c43557-e4ce-4da9-a575-284740a7cf98 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:50.140894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c43557-e4ce-4da9-a575-284740a7cf98 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:50.141115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c43557-e4ce-4da9-a575-284740a7cf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:50.166401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-49c43557-e4ce-4da9-a575-284740a7cf98 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:50.167980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-49c43557-e4ce-4da9-a575-284740a7cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:50.255152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 359/721] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:50.566990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e6ce-0f25-4afc-93a3-b15d68137dc5 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:50.642306 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:50.674823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621e6ce-0f25-4afc-93a3-b15d68137dc5 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:50.710003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de6cfa-0e8f-4ff9-a0ab-4dc53b39a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:50.710618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6cfa-0e8f-4ff9-a0ab-4dc53b39a912 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:50.710892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6cfa-0e8f-4ff9-a0ab-4dc53b39a912 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:50.711370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6cfa-0e8f-4ff9-a0ab-4dc53b39a912 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:50.712022 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de6cfa-0e8f-4ff9-a0ab-4dc53b39a912 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:50.713402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de6cfa-0e8f-4ff9-a0ab-4dc53b39a912 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:50.830944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 363/722] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:40:50 2022] POST /identity/v3/services => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:40:51.060530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a352b7-3ab4-45c9-aea3-9d1b67f7e0ab None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:51.061019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a352b7-3ab4-45c9-aea3-9d1b67f7e0ab None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:51.061019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a352b7-3ab4-45c9-aea3-9d1b67f7e0ab None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:51.062585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 360/723] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:51.069328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d597f-9de0-41bf-a29b-271e21a7dde7 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:51.069632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d597f-9de0-41bf-a29b-271e21a7dde7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:51.069880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d597f-9de0-41bf-a29b-271e21a7dde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:51.089992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-fd9d597f-9de0-41bf-a29b-271e21a7dde7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:51.091202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fd9d597f-9de0-41bf-a29b-271e21a7dde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:51.183613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 364/724] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 19:40:51.488243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a352b7-3ab4-45c9-aea3-9d1b67f7e0ab None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:51.562105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c176299-8fa3-4fd0-b0a0-072bd5f836a3 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:51.567204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c176299-8fa3-4fd0-b0a0-072bd5f836a3 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:51.567204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c176299-8fa3-4fd0-b0a0-072bd5f836a3 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:51.567204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 365/725] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:51.574204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6e91-4f28-45e0-a97b-eef9859fd166 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:51.574493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6e91-4f28-45e0-a97b-eef9859fd166 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:51.574762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb6e91-4f28-45e0-a97b-eef9859fd166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:51.619014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-24cb6e91-4f28-45e0-a97b-eef9859fd166 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:51.619014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-24cb6e91-4f28-45e0-a97b-eef9859fd166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:51.651242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:51.660281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a352b7-3ab4-45c9-aea3-9d1b67f7e0ab None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:51.719279 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7727047-02cc-46d3-9a55-d98eff24b7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:51.719935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7727047-02cc-46d3-9a55-d98eff24b7b0 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:51.720354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7727047-02cc-46d3-9a55-d98eff24b7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:51.721342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7727047-02cc-46d3-9a55-d98eff24b7b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:51.732911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7727047-02cc-46d3-9a55-d98eff24b7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-c7727047-02cc-46d3-9a55-d98eff24b7b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:51.739297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:51.741759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:51.744039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 361/726] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:51.750508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7727047-02cc-46d3-9a55-d98eff24b7b0 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:51.750751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:51.784490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 366/727] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:51.886990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7727047-02cc-46d3-9a55-d98eff24b7b0 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:51.928419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55e96c-c5b1-414e-9b1d-410acfde9d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:51.928419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55e96c-c5b1-414e-9b1d-410acfde9d2f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:51.928419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55e96c-c5b1-414e-9b1d-410acfde9d2f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:51.928419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55e96c-c5b1-414e-9b1d-410acfde9d2f None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:51.929273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55e96c-c5b1-414e-9b1d-410acfde9d2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:51.929273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55e96c-c5b1-414e-9b1d-410acfde9d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:51.930559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55e96c-c5b1-414e-9b1d-410acfde9d2f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:51.940546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 362/728] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:51.952188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb6e91-4f28-45e0-a97b-eef9859fd166 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:52.094985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb6e91-4f28-45e0-a97b-eef9859fd166 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:52.143516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb0cbb-0af0-4b18-ba0e-c4bdb7be053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:52.144256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb0cbb-0af0-4b18-ba0e-c4bdb7be053f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.144536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb0cbb-0af0-4b18-ba0e-c4bdb7be053f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.144806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb0cbb-0af0-4b18-ba0e-c4bdb7be053f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.148431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55e96c-c5b1-414e-9b1d-410acfde9d2f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:52.165265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb0cbb-0af0-4b18-ba0e-c4bdb7be053f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:52.171261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb0cbb-0af0-4b18-ba0e-c4bdb7be053f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-d6cb0cbb-0af0-4b18-ba0e-c4bdb7be053f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:52.185864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:52.186819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:52.187744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:52.187744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:52.187744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:52.187744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 367/729] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:52.193975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb0cbb-0af0-4b18-ba0e-c4bdb7be053f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:52.228890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:52.249245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:52.321181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb0cbb-0af0-4b18-ba0e-c4bdb7be053f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:52.369550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b51dc-df2b-4933-83e0-2595216c9d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:52.370521 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b51dc-df2b-4933-83e0-2595216c9d6c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.371032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b51dc-df2b-4933-83e0-2595216c9d6c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.371525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b51dc-df2b-4933-83e0-2595216c9d6c None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.372371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b51dc-df2b-4933-83e0-2595216c9d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:52.372868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b51dc-df2b-4933-83e0-2595216c9d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:52.374454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b51dc-df2b-4933-83e0-2595216c9d6c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:52.390317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 368/730] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:52.392326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96bf2d-d8b9-460c-b9f0-5e12fb81e0f0 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.393127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96bf2d-d8b9-460c-b9f0-5e12fb81e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.393968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96bf2d-d8b9-460c-b9f0-5e12fb81e0f0 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.396307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 369/731] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:52.397698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96bf2d-d8b9-460c-b9f0-5e12fb81e0f0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:52.403673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55e96c-c5b1-414e-9b1d-410acfde9d2f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:52.442446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba240b95-f78a-4027-aba5-798b8c305a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:52.443436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba240b95-f78a-4027-aba5-798b8c305a79 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.443988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba240b95-f78a-4027-aba5-798b8c305a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.444461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba240b95-f78a-4027-aba5-798b8c305a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.456392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba240b95-f78a-4027-aba5-798b8c305a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-ba240b95-f78a-4027-aba5-798b8c305a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:52.462359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:52.463321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:52.464167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:52.466928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 363/732] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:52.468328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039bb03-d8cd-4e30-82fd-301ad829910d None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.468809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039bb03-d8cd-4e30-82fd-301ad829910d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.469258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039bb03-d8cd-4e30-82fd-301ad829910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.488789 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e039bb03-d8cd-4e30-82fd-301ad829910d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:52.490536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e039bb03-d8cd-4e30-82fd-301ad829910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:52.525238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:52.530930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96bf2d-d8b9-460c-b9f0-5e12fb81e0f0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:52.577640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9253-8168-44c6-bebf-99e55a6b3ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:52.578337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9253-8168-44c6-bebf-99e55a6b3ce9 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.578618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9253-8168-44c6-bebf-99e55a6b3ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.578885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9253-8168-44c6-bebf-99e55a6b3ce9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.579871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 364/733] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:52.581975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039bb03-d8cd-4e30-82fd-301ad829910d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:52.589131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9253-8168-44c6-bebf-99e55a6b3ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:52.590592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9253-8168-44c6-bebf-99e55a6b3ce9 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:52.594477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-8c7a9253-8168-44c6-bebf-99e55a6b3ce9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:52.610161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:52.611180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:52.612245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 370/734] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:52.620889 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9253-8168-44c6-bebf-99e55a6b3ce9 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:52.739858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039bb03-d8cd-4e30-82fd-301ad829910d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:52.771964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9253-8168-44c6-bebf-99e55a6b3ce9 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:52.784806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b2a50-893e-4e4b-a2ea-7ab6b5f38164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:52.785549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b2a50-893e-4e4b-a2ea-7ab6b5f38164 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.785843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b2a50-893e-4e4b-a2ea-7ab6b5f38164 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.786230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b2a50-893e-4e4b-a2ea-7ab6b5f38164 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.786905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b2a50-893e-4e4b-a2ea-7ab6b5f38164 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:52.787206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b2a50-893e-4e4b-a2ea-7ab6b5f38164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:52.788759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b2a50-893e-4e4b-a2ea-7ab6b5f38164 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:52.803857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 365/735] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:52.803857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a23e1-5211-40c4-beb0-559e78b010f5 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.803857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a23e1-5211-40c4-beb0-559e78b010f5 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.803857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a23e1-5211-40c4-beb0-559e78b010f5 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.803857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 366/736] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:52.804822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a23e1-5211-40c4-beb0-559e78b010f5 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:52.818225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10dd64-9867-4f06-989c-75368806ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:52.819348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10dd64-9867-4f06-989c-75368806ff1d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.819847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10dd64-9867-4f06-989c-75368806ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.820531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10dd64-9867-4f06-989c-75368806ff1d None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.821519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10dd64-9867-4f06-989c-75368806ff1d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:52.822026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10dd64-9867-4f06-989c-75368806ff1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:52.823955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10dd64-9867-4f06-989c-75368806ff1d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:52.844018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 371/737] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 19:40:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:40:52.845665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f59d71-31dc-4fc0-a2db-df7d5aa9b697 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.846815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f59d71-31dc-4fc0-a2db-df7d5aa9b697 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.847333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f59d71-31dc-4fc0-a2db-df7d5aa9b697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.866653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-57f59d71-31dc-4fc0-a2db-df7d5aa9b697 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:52.868201 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-57f59d71-31dc-4fc0-a2db-df7d5aa9b697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:52.881561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:52.891671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:52.928917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a23e1-5211-40c4-beb0-559e78b010f5 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:52.956442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 372/738] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 19:40:52.957388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f59d71-31dc-4fc0-a2db-df7d5aa9b697 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:52.974040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8cb7f-6816-47a7-953a-ffec4a0e17ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:52.975005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8cb7f-6816-47a7-953a-ffec4a0e17ad None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:52.975627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8cb7f-6816-47a7-953a-ffec4a0e17ad None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:52.976105 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8cb7f-6816-47a7-953a-ffec4a0e17ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:52.989345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8cb7f-6816-47a7-953a-ffec4a0e17ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:52.990859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8cb7f-6816-47a7-953a-ffec4a0e17ad None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-50b8cb7f-6816-47a7-953a-ffec4a0e17ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:53.009865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:53.010958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:53.016490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:53.016490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:53.016490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:53.016490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 367/739] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:53.016490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8cb7f-6816-47a7-953a-ffec4a0e17ad None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:53.082323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f59d71-31dc-4fc0-a2db-df7d5aa9b697 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:53.121251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b631363-2b01-4c3f-8305-ad0d0934e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:53.122231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b631363-2b01-4c3f-8305-ad0d0934e836 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.122743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b631363-2b01-4c3f-8305-ad0d0934e836 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.123166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b631363-2b01-4c3f-8305-ad0d0934e836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.141856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:53.149034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8cb7f-6816-47a7-953a-ffec4a0e17ad None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:53.180060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:53.195175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85edf90-1e0c-4576-b84f-c474e4d0de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:53.195947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85edf90-1e0c-4576-b84f-c474e4d0de2b None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.197074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85edf90-1e0c-4576-b84f-c474e4d0de2b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.197440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85edf90-1e0c-4576-b84f-c474e4d0de2b None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.199078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85edf90-1e0c-4576-b84f-c474e4d0de2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:53.200845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b631363-2b01-4c3f-8305-ad0d0934e836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:53.208355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85edf90-1e0c-4576-b84f-c474e4d0de2b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:53.208483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b631363-2b01-4c3f-8305-ad0d0934e836 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:53.295531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 368/740] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:40:53 2022] POST /identity/v3/services => generated 240 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:40:53.300776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85edf90-1e0c-4576-b84f-c474e4d0de2b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:53.324640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 373/741] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:52 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 19:40:53.328832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b631363-2b01-4c3f-8305-ad0d0934e836 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:53.393697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:53.453324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85edf90-1e0c-4576-b84f-c474e4d0de2b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:53.483287 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b631363-2b01-4c3f-8305-ad0d0934e836 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:53.497418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b5013-e5eb-403d-9634-ad313b31c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:53.498037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b5013-e5eb-403d-9634-ad313b31c9fd None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.498318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b5013-e5eb-403d-9634-ad313b31c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.498591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b5013-e5eb-403d-9634-ad313b31c9fd None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.499323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b5013-e5eb-403d-9634-ad313b31c9fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:53.499575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b5013-e5eb-403d-9634-ad313b31c9fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:53.500968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b5013-e5eb-403d-9634-ad313b31c9fd None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:53.516683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 369/742] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:53.517572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b5013-e5eb-403d-9634-ad313b31c9fd None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:53.530643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4599bbf-3c13-4016-86db-9a7818ccb32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:53.531683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4599bbf-3c13-4016-86db-9a7818ccb32b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.531967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4599bbf-3c13-4016-86db-9a7818ccb32b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.532239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4599bbf-3c13-4016-86db-9a7818ccb32b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.546786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4599bbf-3c13-4016-86db-9a7818ccb32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-d4599bbf-3c13-4016-86db-9a7818ccb32b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:53.554926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:53.555904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:40:53.556741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:53.557933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 374/743] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:40:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:53.558531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4599bbf-3c13-4016-86db-9a7818ccb32b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:53.566089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:53.626069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b5013-e5eb-403d-9634-ad313b31c9fd None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:53.664075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b691cf-ac5a-45a7-b2e6-4ae978281de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:53.664713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b691cf-ac5a-45a7-b2e6-4ae978281de5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.664992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b691cf-ac5a-45a7-b2e6-4ae978281de5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.665409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b691cf-ac5a-45a7-b2e6-4ae978281de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.675091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4599bbf-3c13-4016-86db-9a7818ccb32b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:53.677121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b691cf-ac5a-45a7-b2e6-4ae978281de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:53.678814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b691cf-ac5a-45a7-b2e6-4ae978281de5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:53.682228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-07b691cf-ac5a-45a7-b2e6-4ae978281de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:53.696631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:53.702053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:53.702940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:53.702940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:53.702940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:53.702940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 370/744] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:53.702940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b691cf-ac5a-45a7-b2e6-4ae978281de5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:53.716717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7126b15-5228-48fe-adb9-c0ec4add62fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:53.717364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7126b15-5228-48fe-adb9-c0ec4add62fc None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.717643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7126b15-5228-48fe-adb9-c0ec4add62fc None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.717914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7126b15-5228-48fe-adb9-c0ec4add62fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.726219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7126b15-5228-48fe-adb9-c0ec4add62fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:53.728208 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7126b15-5228-48fe-adb9-c0ec4add62fc None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-c7126b15-5228-48fe-adb9-c0ec4add62fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:53.740611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:53.741714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:53.742650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 375/745] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 19:40:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:53.743470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b91a1-7289-4d3c-8cb6-47d7ba4f6d18 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.743755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b91a1-7289-4d3c-8cb6-47d7ba4f6d18 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.744030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b91a1-7289-4d3c-8cb6-47d7ba4f6d18 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.745523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 376/746] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:53.746519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b91a1-7289-4d3c-8cb6-47d7ba4f6d18 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:53.811786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:53.824582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b691cf-ac5a-45a7-b2e6-4ae978281de5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:53.858845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b91a1-7289-4d3c-8cb6-47d7ba4f6d18 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:53.863155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b46219-349d-460b-819b-f250fe649782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:53.863927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46219-349d-460b-819b-f250fe649782 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.864215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46219-349d-460b-819b-f250fe649782 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.864483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46219-349d-460b-819b-f250fe649782 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.865148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b46219-349d-460b-819b-f250fe649782 None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:53.865443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b46219-349d-460b-819b-f250fe649782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:53.866823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b46219-349d-460b-819b-f250fe649782 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:53.875024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 371/747] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:40:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:53.875858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b46219-349d-460b-819b-f250fe649782 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:53.904154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300eb4d-029d-4b34-be0c-0dd4038e8f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:53.904973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300eb4d-029d-4b34-be0c-0dd4038e8f50 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.905255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300eb4d-029d-4b34-be0c-0dd4038e8f50 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.905528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300eb4d-029d-4b34-be0c-0dd4038e8f50 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.906182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300eb4d-029d-4b34-be0c-0dd4038e8f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:53.906483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300eb4d-029d-4b34-be0c-0dd4038e8f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:53.907888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300eb4d-029d-4b34-be0c-0dd4038e8f50 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:53.928923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 377/748] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:53.928923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac9a8-12d3-4bcb-ac77-371e0b9c4e51 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:53.928923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac9a8-12d3-4bcb-ac77-371e0b9c4e51 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:53.928923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac9a8-12d3-4bcb-ac77-371e0b9c4e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:53.945597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-091ac9a8-12d3-4bcb-ac77-371e0b9c4e51 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:53.947081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-091ac9a8-12d3-4bcb-ac77-371e0b9c4e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:53.968252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:53.998210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b46219-349d-460b-819b-f250fe649782 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.027934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 378/749] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:40:54.029161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ac9a8-12d3-4bcb-ac77-371e0b9c4e51 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.036634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9813ff-4ccb-4b73-966b-86f0cfc16296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.037511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9813ff-4ccb-4b73-966b-86f0cfc16296 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.037984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9813ff-4ccb-4b73-966b-86f0cfc16296 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.038447 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9813ff-4ccb-4b73-966b-86f0cfc16296 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.039458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9813ff-4ccb-4b73-966b-86f0cfc16296 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:54.039959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9813ff-4ccb-4b73-966b-86f0cfc16296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.041665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9813ff-4ccb-4b73-966b-86f0cfc16296 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.060175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 372/750] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 19:40:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:54.061313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9813ff-4ccb-4b73-966b-86f0cfc16296 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.075016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:54.158787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ac9a8-12d3-4bcb-ac77-371e0b9c4e51 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.172715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9813ff-4ccb-4b73-966b-86f0cfc16296 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.198109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6802409-2424-420e-b7a9-6274c7f275e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.198751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6802409-2424-420e-b7a9-6274c7f275e7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.199027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6802409-2424-420e-b7a9-6274c7f275e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.199326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6802409-2424-420e-b7a9-6274c7f275e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.210858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3afb7-7cbd-4b1a-9518-547c96377afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.211067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6802409-2424-420e-b7a9-6274c7f275e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.211970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3afb7-7cbd-4b1a-9518-547c96377afd None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.212443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3afb7-7cbd-4b1a-9518-547c96377afd None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.212548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6802409-2424-420e-b7a9-6274c7f275e7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.213013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3afb7-7cbd-4b1a-9518-547c96377afd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.220189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3afb7-7cbd-4b1a-9518-547c96377afd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.222347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3afb7-7cbd-4b1a-9518-547c96377afd None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-e6802409-2424-420e-b7a9-6274c7f275e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:54.228055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:54.228995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:54.229870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:54.229870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:54.229870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:54.233866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 379/751] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:54.234683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6802409-2424-420e-b7a9-6274c7f275e7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-72f3afb7-7cbd-4b1a-9518-547c96377afd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:54.237778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:54.238630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:54.239545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:54.239545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:54.239545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:54.239545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:54.239545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:54.239545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:54.239545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:54.239545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:54.246224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 373/752] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:54.247200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:54.247886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3afb7-7cbd-4b1a-9518-547c96377afd None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.326085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:54.348579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6802409-2424-420e-b7a9-6274c7f275e7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.360269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3afb7-7cbd-4b1a-9518-547c96377afd None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.383974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a888b-ef88-47b0-b8dc-f5ea16e3e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.384614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a888b-ef88-47b0-b8dc-f5ea16e3e622 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.384894 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a888b-ef88-47b0-b8dc-f5ea16e3e622 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.385165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a888b-ef88-47b0-b8dc-f5ea16e3e622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.398407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a888b-ef88-47b0-b8dc-f5ea16e3e622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.398684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3943-e192-44c7-8927-5722440bc717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.399635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3943-e192-44c7-8927-5722440bc717 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.399896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a888b-ef88-47b0-b8dc-f5ea16e3e622 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.399991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3943-e192-44c7-8927-5722440bc717 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.400171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d3943-e192-44c7-8927-5722440bc717 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.400818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d3943-e192-44c7-8927-5722440bc717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:54.401116 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d3943-e192-44c7-8927-5722440bc717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.402479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d3943-e192-44c7-8927-5722440bc717 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.414528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 374/753] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:54.415387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3943-e192-44c7-8927-5722440bc717 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-059a888b-ef88-47b0-b8dc-f5ea16e3e622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:54.417865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:54.419355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:54.420525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:54.420525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:54.420525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:54.423649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 380/754] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:54.425161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a888b-ef88-47b0-b8dc-f5ea16e3e622 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.491316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:54.534770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d3943-e192-44c7-8927-5722440bc717 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.536074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a888b-ef88-47b0-b8dc-f5ea16e3e622 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.566274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:54.570266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373e961-a1f3-4ebc-affe-cd35f3ed1349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.570893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e961-a1f3-4ebc-affe-cd35f3ed1349 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.571170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e961-a1f3-4ebc-affe-cd35f3ed1349 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.571470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373e961-a1f3-4ebc-affe-cd35f3ed1349 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.572082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373e961-a1f3-4ebc-affe-cd35f3ed1349 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.572269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8255f-a0f5-45e9-a2a6-3dc616e534be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.572875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8255f-a0f5-45e9-a2a6-3dc616e534be None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.573152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8255f-a0f5-45e9-a2a6-3dc616e534be None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.573416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373e961-a1f3-4ebc-affe-cd35f3ed1349 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.573507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8255f-a0f5-45e9-a2a6-3dc616e534be None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.574107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8255f-a0f5-45e9-a2a6-3dc616e534be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:54.574413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8255f-a0f5-45e9-a2a6-3dc616e534be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.576965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8255f-a0f5-45e9-a2a6-3dc616e534be None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-a373e961-a1f3-4ebc-affe-cd35f3ed1349 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:54.582403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:54.583588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:54.584436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 381/755] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:54.585928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373e961-a1f3-4ebc-affe-cd35f3ed1349 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.598100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 375/756] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:54.598100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8255f-a0f5-45e9-a2a6-3dc616e534be None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.692590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373e961-a1f3-4ebc-affe-cd35f3ed1349 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.701578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8255f-a0f5-45e9-a2a6-3dc616e534be None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.717764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:54.729617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa464c-8139-43dd-b060-f6cecb4648df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.731330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa464c-8139-43dd-b060-f6cecb4648df None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.731330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa464c-8139-43dd-b060-f6cecb4648df None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.731330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa464c-8139-43dd-b060-f6cecb4648df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.739973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa464c-8139-43dd-b060-f6cecb4648df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.741418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa464c-8139-43dd-b060-f6cecb4648df None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.741890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad1851-552d-44d3-bc3f-d80c58b73ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.742497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad1851-552d-44d3-bc3f-d80c58b73ad5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.742855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad1851-552d-44d3-bc3f-d80c58b73ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.743132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad1851-552d-44d3-bc3f-d80c58b73ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.743813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad1851-552d-44d3-bc3f-d80c58b73ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:54.744182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad1851-552d-44d3-bc3f-d80c58b73ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.745553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad1851-552d-44d3-bc3f-d80c58b73ad5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-5dfa464c-8139-43dd-b060-f6cecb4648df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:54.755172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:54.756307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:54.757311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 382/757] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:54.757930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa464c-8139-43dd-b060-f6cecb4648df None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.763862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 376/758] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:54.764858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad1851-552d-44d3-bc3f-d80c58b73ad5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.821553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:54.865763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa464c-8139-43dd-b060-f6cecb4648df None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.876215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad1851-552d-44d3-bc3f-d80c58b73ad5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:54.903019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fb046-e1e4-4072-8d7d-c237bfec9a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.903661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fb046-e1e4-4072-8d7d-c237bfec9a5d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.903940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fb046-e1e4-4072-8d7d-c237bfec9a5d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.904210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fb046-e1e4-4072-8d7d-c237bfec9a5d None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.904845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fb046-e1e4-4072-8d7d-c237bfec9a5d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:54.905149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fb046-e1e4-4072-8d7d-c237bfec9a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.906526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fb046-e1e4-4072-8d7d-c237bfec9a5d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.912177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 383/759] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:54.912793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fb046-e1e4-4072-8d7d-c237bfec9a5d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.919101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859f51-def7-406d-932c-c59c64041d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:54.919759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859f51-def7-406d-932c-c59c64041d52 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:54.920035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859f51-def7-406d-932c-c59c64041d52 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:54.920302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4859f51-def7-406d-932c-c59c64041d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:54.921035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859f51-def7-406d-932c-c59c64041d52 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=5a1eeb59bfa24e4bb6658aa4bb5f7852) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:54.921340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859f51-def7-406d-932c-c59c64041d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:54.922773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4859f51-def7-406d-932c-c59c64041d52 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:54.939254 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 377/760] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/role_assignments?user.id=5a1eeb59bfa24e4bb6658aa4bb5f7852&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=9ec7f759c0a64655b794dfb597930076 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:54.939254 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859f51-def7-406d-932c-c59c64041d52 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:54.985999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:55.064663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4859f51-def7-406d-932c-c59c64041d52 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:55.066934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fb046-e1e4-4072-8d7d-c237bfec9a5d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:55.082309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:55.110865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb4dd6-90aa-43e7-a026-62d5d64c6e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:55.112647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb4dd6-90aa-43e7-a026-62d5d64c6e12 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:55.113216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb4dd6-90aa-43e7-a026-62d5d64c6e12 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:55.113645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb4dd6-90aa-43e7-a026-62d5d64c6e12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:55.113869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bcb67-c242-4dab-ae80-ff335cd897fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:55.114657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bcb67-c242-4dab-ae80-ff335cd897fb None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:55.115038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bcb67-c242-4dab-ae80-ff335cd897fb None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:55.115445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bcb67-c242-4dab-ae80-ff335cd897fb None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:55.116344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bcb67-c242-4dab-ae80-ff335cd897fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:55.116703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bcb67-c242-4dab-ae80-ff335cd897fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:55.118348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bcb67-c242-4dab-ae80-ff335cd897fb None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:55.123450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb4dd6-90aa-43e7-a026-62d5d64c6e12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:55.125088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb4dd6-90aa-43e7-a026-62d5d64c6e12 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:55.143824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 384/761] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:55.143824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bcb67-c242-4dab-ae80-ff335cd897fb None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-debb4dd6-90aa-43e7-a026-62d5d64c6e12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:55.149047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:55.150214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:55.151375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:55.151375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:55.151375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:55.151375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:55.151375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:55.151375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:55.151375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:55.151375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:55.154419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 378/762] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:55.155298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb4dd6-90aa-43e7-a026-62d5d64c6e12 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:55.268512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bcb67-c242-4dab-ae80-ff335cd897fb None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:55.279447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:55.284675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb4dd6-90aa-43e7-a026-62d5d64c6e12 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:55.320046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48425e07-778a-4ded-90c5-587b1159787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:55.320656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48425e07-778a-4ded-90c5-587b1159787b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:55.320933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48425e07-778a-4ded-90c5-587b1159787b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:55.321198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48425e07-778a-4ded-90c5-587b1159787b None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:55.321831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48425e07-778a-4ded-90c5-587b1159787b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:55.322156 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48425e07-778a-4ded-90c5-587b1159787b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:55.323551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48425e07-778a-4ded-90c5-587b1159787b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:55.324502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d296f8-b2a3-4f30-8a8f-3736b302802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:55.325361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d296f8-b2a3-4f30-8a8f-3736b302802d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:55.326043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d296f8-b2a3-4f30-8a8f-3736b302802d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:55.326317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d296f8-b2a3-4f30-8a8f-3736b302802d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:55.333691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 385/763] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 19:40:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:55.333691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48425e07-778a-4ded-90c5-587b1159787b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:55.383982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:55.415160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d296f8-b2a3-4f30-8a8f-3736b302802d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:55.416661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d296f8-b2a3-4f30-8a8f-3736b302802d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:55.458804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48425e07-778a-4ded-90c5-587b1159787b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:55.497527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3073d-bfa6-4b01-8be7-91512a03c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:55.498414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3073d-bfa6-4b01-8be7-91512a03c288 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:55.498414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3073d-bfa6-4b01-8be7-91512a03c288 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:55.498668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3073d-bfa6-4b01-8be7-91512a03c288 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:55.499406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3073d-bfa6-4b01-8be7-91512a03c288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:55.499708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3073d-bfa6-4b01-8be7-91512a03c288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:55.501147 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3073d-bfa6-4b01-8be7-91512a03c288 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:55.513305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 386/764] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:55.514559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdc2fd-0527-4913-8def-e16895ed36aa None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:55.514844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdc2fd-0527-4913-8def-e16895ed36aa None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:55.515115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdc2fd-0527-4913-8def-e16895ed36aa None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:55.516465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 387/765] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:55.517060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdc2fd-0527-4913-8def-e16895ed36aa None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:55.529848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 379/766] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:40:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:40:55.530676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d296f8-b2a3-4f30-8a8f-3736b302802d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:55.554018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:55.617187 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:55.636346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdc2fd-0527-4913-8def-e16895ed36aa None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:55.644968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d296f8-b2a3-4f30-8a8f-3736b302802d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:55.670897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f597a76-a9b2-4d3f-9997-c7d8700f09c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:55.671547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597a76-a9b2-4d3f-9997-c7d8700f09c7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:55.671827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597a76-a9b2-4d3f-9997-c7d8700f09c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:55.672108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f597a76-a9b2-4d3f-9997-c7d8700f09c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:55.672804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f597a76-a9b2-4d3f-9997-c7d8700f09c7 None admin] RBAC: Adding query filter params (interface=public, service_id=41234856d204458090922ccf24dbfc57, region_id=RegionOne) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:55.673114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f597a76-a9b2-4d3f-9997-c7d8700f09c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:55.675089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f597a76-a9b2-4d3f-9997-c7d8700f09c7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:55.682472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 388/767] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 19:40:55 2022] GET /identity/v3/endpoints?service_id=41234856d204458090922ccf24dbfc57&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:55.683663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479d288-3c9b-471f-9266-56ab83e548a8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:55.683945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479d288-3c9b-471f-9266-56ab83e548a8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:55.684215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479d288-3c9b-471f-9266-56ab83e548a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:55.687677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e0245-459b-4018-979f-001b292815f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:55.688331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e0245-459b-4018-979f-001b292815f7 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:55.688606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e0245-459b-4018-979f-001b292815f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:55.688872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e0245-459b-4018-979f-001b292815f7 None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1787fcb6f7c34de59c9682a4d8c3d2a3/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:55.691431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e0245-459b-4018-979f-001b292815f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=1787fcb6f7c34de59c9682a4d8c3d2a3, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:55.692896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e0245-459b-4018-979f-001b292815f7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:55.702961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-9479d288-3c9b-471f-9266-56ab83e548a8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:55.704213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9479d288-3c9b-471f-9266-56ab83e548a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:55.770986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 380/768] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:40:55 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1787fcb6f7c34de59c9682a4d8c3d2a3/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:40:55.772473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e0245-459b-4018-979f-001b292815f7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:55.772963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 389/769] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:40:55.773979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479d288-3c9b-471f-9266-56ab83e548a8 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:55.835597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:55.969858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e0245-459b-4018-979f-001b292815f7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:55.970074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479d288-3c9b-471f-9266-56ab83e548a8 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:56.022301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3396d7-2cf3-45d6-8147-a4fe9128c495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:56.024286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f1a87-7873-4dea-90ed-c934e512a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:56.025091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f1a87-7873-4dea-90ed-c934e512a976 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:56.025508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f1a87-7873-4dea-90ed-c934e512a976 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:56.025916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f1a87-7873-4dea-90ed-c934e512a976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:56.027962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3396d7-2cf3-45d6-8147-a4fe9128c495 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:56.028257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3396d7-2cf3-45d6-8147-a4fe9128c495 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:56.028536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3396d7-2cf3-45d6-8147-a4fe9128c495 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:56.029167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3396d7-2cf3-45d6-8147-a4fe9128c495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:56.030577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3396d7-2cf3-45d6-8147-a4fe9128c495 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:56.036177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:56.039706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 390/770] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 19:40:55 2022] GET /identity/v3/services => generated 772 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:56.042321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f1a87-7873-4dea-90ed-c934e512a976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:56.043965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f1a87-7873-4dea-90ed-c934e512a976 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-124f1a87-7873-4dea-90ed-c934e512a976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:56.061772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:56.062801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:56.064149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:56.064149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:56.064149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:56.064149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 381/771] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:56.069859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3396d7-2cf3-45d6-8147-a4fe9128c495 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:56.171962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:56.185567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3396d7-2cf3-45d6-8147-a4fe9128c495 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:56.191123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f1a87-7873-4dea-90ed-c934e512a976 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:56.234042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3c77c-1db2-41e2-b4a1-c7d8ce0a2283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:56.235044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3c77c-1db2-41e2-b4a1-c7d8ce0a2283 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:56.235367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3c77c-1db2-41e2-b4a1-c7d8ce0a2283 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:56.235635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3c77c-1db2-41e2-b4a1-c7d8ce0a2283 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:56.236331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3c77c-1db2-41e2-b4a1-c7d8ce0a2283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:56.236634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3c77c-1db2-41e2-b4a1-c7d8ce0a2283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:56.238052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3c77c-1db2-41e2-b4a1-c7d8ce0a2283 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:56.258093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 391/772] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:56.263431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3c77c-1db2-41e2-b4a1-c7d8ce0a2283 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:56.346183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f1a87-7873-4dea-90ed-c934e512a976 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:56.377650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3c77c-1db2-41e2-b4a1-c7d8ce0a2283 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:56.397589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07897437-1fce-48b4-8c94-64467ab02b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:56.398241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897437-1fce-48b4-8c94-64467ab02b33 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:56.398522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897437-1fce-48b4-8c94-64467ab02b33 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:56.398797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07897437-1fce-48b4-8c94-64467ab02b33 None admin] PATH_INFO: `/v3/services/network` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:56.400688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07897437-1fce-48b4-8c94-64467ab02b33 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:56.400796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07897437-1fce-48b4-8c94-64467ab02b33 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-07897437-1fce-48b4-8c94-64467ab02b33 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:56.411646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:56.412681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 19:40:56.413528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:56.416511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 382/773] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:56 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:56.424278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07897437-1fce-48b4-8c94-64467ab02b33 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:56.485411 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:56.545862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07897437-1fce-48b4-8c94-64467ab02b33 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:56.546881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825b415-071e-4b48-bfc9-b0561561b0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:56.547780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825b415-071e-4b48-bfc9-b0561561b0ec None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:56.548272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825b415-071e-4b48-bfc9-b0561561b0ec None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:56.549278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825b415-071e-4b48-bfc9-b0561561b0ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:56.576018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825b415-071e-4b48-bfc9-b0561561b0ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:56.577834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825b415-071e-4b48-bfc9-b0561561b0ec None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:56.583641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a649b26-105c-4b1b-9a56-692abeba8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:56.584256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a649b26-105c-4b1b-9a56-692abeba8bcf None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:56.584534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a649b26-105c-4b1b-9a56-692abeba8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:56.584801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a649b26-105c-4b1b-9a56-692abeba8bcf None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:56.585441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a649b26-105c-4b1b-9a56-692abeba8bcf None admin] RBAC: Adding query filter params (name=network) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:56.585743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a649b26-105c-4b1b-9a56-692abeba8bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:56.587365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a649b26-105c-4b1b-9a56-692abeba8bcf None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:56.593014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 383/774] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:40:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-2825b415-071e-4b48-bfc9-b0561561b0ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:40:56.598857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:56.599769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:56.600654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:40:56.600654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:40:56.600654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:40:56.600654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:40:56.600654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:40:56.600654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:40:56.600654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:40:56.600654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:56.602924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 392/775] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:56.607392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a649b26-105c-4b1b-9a56-692abeba8bcf None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:56.608875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825b415-071e-4b48-bfc9-b0561561b0ec None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:56.633833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:56.754605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825b415-071e-4b48-bfc9-b0561561b0ec None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:56.794800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139c719-3eac-41b5-a233-5cb298733a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:56.795871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c719-3eac-41b5-a233-5cb298733a6d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:56.796391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c719-3eac-41b5-a233-5cb298733a6d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:56.796863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139c719-3eac-41b5-a233-5cb298733a6d None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:56.797757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139c719-3eac-41b5-a233-5cb298733a6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:56.798271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139c719-3eac-41b5-a233-5cb298733a6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:56.799058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a649b26-105c-4b1b-9a56-692abeba8bcf None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:56.800225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139c719-3eac-41b5-a233-5cb298733a6d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:56.813556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 393/776] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:56.819785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139c719-3eac-41b5-a233-5cb298733a6d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:56.843591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:56.870386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3c32f-f0cc-4af2-9575-5f6be388ac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:56.871410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c32f-f0cc-4af2-9575-5f6be388ac58 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:56.872764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c32f-f0cc-4af2-9575-5f6be388ac58 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:56.874402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c32f-f0cc-4af2-9575-5f6be388ac58 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:56.875284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3c32f-f0cc-4af2-9575-5f6be388ac58 None admin] RBAC: Adding query filter params (type=network) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:56.877325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3c32f-f0cc-4af2-9575-5f6be388ac58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:56.880506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3c32f-f0cc-4af2-9575-5f6be388ac58 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:56.895446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 384/777] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:40:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:56.901013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3c32f-f0cc-4af2-9575-5f6be388ac58 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:56.944175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:56.985303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139c719-3eac-41b5-a233-5cb298733a6d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:57.026975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e9235-67ad-497a-ac17-0e56251c2af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:57.027634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e9235-67ad-497a-ac17-0e56251c2af8 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:57.027887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e9235-67ad-497a-ac17-0e56251c2af8 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:57.028051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e9235-67ad-497a-ac17-0e56251c2af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:57.028830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e9235-67ad-497a-ac17-0e56251c2af8 None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=2e09e41723f5430aad58bbca945d1447) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:57.029136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e9235-67ad-497a-ac17-0e56251c2af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:57.030576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e9235-67ad-497a-ac17-0e56251c2af8 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:57.032769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3c32f-f0cc-4af2-9575-5f6be388ac58 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:57.037634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 394/778] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:40:56 2022] GET /identity/v3/role_assignments?user.id=2e09e41723f5430aad58bbca945d1447&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:57.038822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8454c-05ea-469a-a0cd-0b78c83fdb49 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:57.039245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8454c-05ea-469a-a0cd-0b78c83fdb49 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:57.039514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8454c-05ea-469a-a0cd-0b78c83fdb49 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:57.043558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 395/779] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:57.051253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44178d-1f45-48d3-96f8-15ead16d0e7d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:57.051253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44178d-1f45-48d3-96f8-15ead16d0e7d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:57.051253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44178d-1f45-48d3-96f8-15ead16d0e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:57.088335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-4f44178d-1f45-48d3-96f8-15ead16d0e7d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:57.089974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4f44178d-1f45-48d3-96f8-15ead16d0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:57.111033 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69466dcc-66bb-40aa-8dab-4cbf6990f555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:57.112210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69466dcc-66bb-40aa-8dab-4cbf6990f555 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:57.112746 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69466dcc-66bb-40aa-8dab-4cbf6990f555 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:57.114613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69466dcc-66bb-40aa-8dab-4cbf6990f555 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:57.115677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69466dcc-66bb-40aa-8dab-4cbf6990f555 None admin] RBAC: Adding query filter params (interface=public, service_id=52a7617166ed4427bf61afcae33bc4ad, region_id=RegionOne) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:57.116234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69466dcc-66bb-40aa-8dab-4cbf6990f555 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:57.118480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69466dcc-66bb-40aa-8dab-4cbf6990f555 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:57.135039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 385/780] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 19:40:56 2022] GET /identity/v3/endpoints?service_id=52a7617166ed4427bf61afcae33bc4ad&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:57.139612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69466dcc-66bb-40aa-8dab-4cbf6990f555 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:57.232887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:57.247266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 396/781] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:40:57.300948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69466dcc-66bb-40aa-8dab-4cbf6990f555 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:57.337800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb24f9-6246-4994-aae7-7156cd5968bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:57.338413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb24f9-6246-4994-aae7-7156cd5968bc None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:57.338689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb24f9-6246-4994-aae7-7156cd5968bc None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:57.338959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb24f9-6246-4994-aae7-7156cd5968bc None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:57.339619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb24f9-6246-4994-aae7-7156cd5968bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:57.341000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb24f9-6246-4994-aae7-7156cd5968bc None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:57.348855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 386/782] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 19:40:57 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:57.660818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44178d-1f45-48d3-96f8-15ead16d0e7d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:57.866951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:57.901165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44178d-1f45-48d3-96f8-15ead16d0e7d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:57.937010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b4ea8-7c3c-48a1-bd5b-43e8a722377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:57.937653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b4ea8-7c3c-48a1-bd5b-43e8a722377d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:57.937934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b4ea8-7c3c-48a1-bd5b-43e8a722377d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:57.938210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b4ea8-7c3c-48a1-bd5b-43e8a722377d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:57.949963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b4ea8-7c3c-48a1-bd5b-43e8a722377d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-883b4ea8-7c3c-48a1-bd5b-43e8a722377d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:57.954769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:57.955771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:57.956647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 397/783] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:57.962420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb24f9-6246-4994-aae7-7156cd5968bc None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:58.230896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb24f9-6246-4994-aae7-7156cd5968bc None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:58.242321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:58.275242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de72c42-c887-4d86-89a1-ff2b8a89573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:58.276101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de72c42-c887-4d86-89a1-ff2b8a89573d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:58.276452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6bed-4575-45bd-9845-392f637651eb None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:58.277007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de72c42-c887-4d86-89a1-ff2b8a89573d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:58.277255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6bed-4575-45bd-9845-392f637651eb None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:58.277537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6bed-4575-45bd-9845-392f637651eb None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:58.277753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de72c42-c887-4d86-89a1-ff2b8a89573d None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:58.278578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de72c42-c887-4d86-89a1-ff2b8a89573d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:58.280262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de72c42-c887-4d86-89a1-ff2b8a89573d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:58.280383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 398/784] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:58.282796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de72c42-c887-4d86-89a1-ff2b8a89573d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:58.285077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef27f8-cd2a-445a-8005-f6c67f5b5eb0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:58.285296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef27f8-cd2a-445a-8005-f6c67f5b5eb0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:58.285571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef27f8-cd2a-445a-8005-f6c67f5b5eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:58.293469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 387/785] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:58.299317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de72c42-c887-4d86-89a1-ff2b8a89573d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:58.320289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d9ef27f8-cd2a-445a-8005-f6c67f5b5eb0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:58.321513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d9ef27f8-cd2a-445a-8005-f6c67f5b5eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:58.454392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 399/786] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:40:58.471343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de72c42-c887-4d86-89a1-ff2b8a89573d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:58.505897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4aef5-d1f9-455c-b5f4-26c46ee34830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:58.506453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4aef5-d1f9-455c-b5f4-26c46ee34830 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:58.506728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4aef5-d1f9-455c-b5f4-26c46ee34830 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:58.506992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4aef5-d1f9-455c-b5f4-26c46ee34830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:58.518278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4aef5-d1f9-455c-b5f4-26c46ee34830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:58.519767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4aef5-d1f9-455c-b5f4-26c46ee34830 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-6cd4aef5-d1f9-455c-b5f4-26c46ee34830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:58.533931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:58.534873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:58.535792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:58.535792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:58.535792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:58.539325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 388/787] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:40:58.540877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef27f8-cd2a-445a-8005-f6c67f5b5eb0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:58.570466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063bb1a-e746-4069-918b-63338dffdbee None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:58.570762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063bb1a-e746-4069-918b-63338dffdbee None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:58.571008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063bb1a-e746-4069-918b-63338dffdbee None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:58.572510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 389/788] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:40:58.577364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266e841-9fff-4c97-a689-17464cb502b2 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:58.577645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266e841-9fff-4c97-a689-17464cb502b2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:58.577917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266e841-9fff-4c97-a689-17464cb502b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:58.602605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e266e841-9fff-4c97-a689-17464cb502b2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:58.607322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e266e841-9fff-4c97-a689-17464cb502b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:58.637435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:58.652998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:58.734964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 390/789] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:40:58.743511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef27f8-cd2a-445a-8005-f6c67f5b5eb0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:58.785007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2f2c0-4047-458d-9829-35167c5b296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:58.785545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2f2c0-4047-458d-9829-35167c5b296e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:58.785821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2f2c0-4047-458d-9829-35167c5b296e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:58.786089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2f2c0-4047-458d-9829-35167c5b296e None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:58.786755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2f2c0-4047-458d-9829-35167c5b296e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:58.787035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2f2c0-4047-458d-9829-35167c5b296e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:58.788429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2f2c0-4047-458d-9829-35167c5b296e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:58.804884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 400/790] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:58.810367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266e841-9fff-4c97-a689-17464cb502b2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:58.826011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2f2c0-4047-458d-9829-35167c5b296e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:58.989269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266e841-9fff-4c97-a689-17464cb502b2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.021060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2f2c0-4047-458d-9829-35167c5b296e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.049180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:59.064727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42032a82-f1c3-45c8-ab7b-dc2b6c8f1ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.067055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032a82-f1c3-45c8-ab7b-dc2b6c8f1ebe None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.067055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032a82-f1c3-45c8-ab7b-dc2b6c8f1ebe None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.067055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42032a82-f1c3-45c8-ab7b-dc2b6c8f1ebe None admin] PATH_INFO: `/v3/users/swift` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.082300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032a82-f1c3-45c8-ab7b-dc2b6c8f1ebe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:59.084121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42032a82-f1c3-45c8-ab7b-dc2b6c8f1ebe None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:59.091322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2a021-6748-4bd2-be7e-4871c985bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.092375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2a021-6748-4bd2-be7e-4871c985bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.094954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2a021-6748-4bd2-be7e-4871c985bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.098601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2a021-6748-4bd2-be7e-4871c985bbf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-42032a82-f1c3-45c8-ab7b-dc2b6c8f1ebe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:40:59.105013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:59.105972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 391/791] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:59.107161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42032a82-f1c3-45c8-ab7b-dc2b6c8f1ebe None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:59.117747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2a021-6748-4bd2-be7e-4871c985bbf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-69a2a021-6748-4bd2-be7e-4871c985bbf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:40:59.122445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:59.123594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 401/792] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:40:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:59.128711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2a021-6748-4bd2-be7e-4871c985bbf8 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:59.135354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:59.237342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2a021-6748-4bd2-be7e-4871c985bbf8 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.258821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42032a82-f1c3-45c8-ab7b-dc2b6c8f1ebe None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.273181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db9e1c-cc42-4c52-b13c-633c2f42db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.273789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db9e1c-cc42-4c52-b13c-633c2f42db5f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.274100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db9e1c-cc42-4c52-b13c-633c2f42db5f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.274318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db9e1c-cc42-4c52-b13c-633c2f42db5f None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.275048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db9e1c-cc42-4c52-b13c-633c2f42db5f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:59.275384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db9e1c-cc42-4c52-b13c-633c2f42db5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:59.276917 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db9e1c-cc42-4c52-b13c-633c2f42db5f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:59.318625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 402/793] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 19:40:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:59.318625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db9e1c-cc42-4c52-b13c-633c2f42db5f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:59.318909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cebf2d-0c92-49ab-8c25-0874332ed3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.318909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cebf2d-0c92-49ab-8c25-0874332ed3a1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.318909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cebf2d-0c92-49ab-8c25-0874332ed3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.318909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cebf2d-0c92-49ab-8c25-0874332ed3a1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.319264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cebf2d-0c92-49ab-8c25-0874332ed3a1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:59.319264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cebf2d-0c92-49ab-8c25-0874332ed3a1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-f1cebf2d-0c92-49ab-8c25-0874332ed3a1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:59.324170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:59.325369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 19:40:59.326385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:59.328496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 392/794] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Aug 22 19:40:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:59.331381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051864e1-f525-41b8-9a59-94d7d434039a None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.331672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051864e1-f525-41b8-9a59-94d7d434039a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.331940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051864e1-f525-41b8-9a59-94d7d434039a None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.333383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 393/795] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:59.333894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051864e1-f525-41b8-9a59-94d7d434039a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:59.342440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:59.420714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db9e1c-cc42-4c52-b13c-633c2f42db5f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.431823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:59.458300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051864e1-f525-41b8-9a59-94d7d434039a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.458492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04d7d7-fb84-4a2a-875d-577fa27ae14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.459117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d7d7-fb84-4a2a-875d-577fa27ae14f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.459427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d7d7-fb84-4a2a-875d-577fa27ae14f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.459691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d7d7-fb84-4a2a-875d-577fa27ae14f None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.460364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d7d7-fb84-4a2a-875d-577fa27ae14f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:59.460666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d7d7-fb84-4a2a-875d-577fa27ae14f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:59.462035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d7d7-fb84-4a2a-875d-577fa27ae14f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:59.475119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 403/796] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:40:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:59.475119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602ce4-7d25-427b-bef6-d0aa9a08d0c5 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.475119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602ce4-7d25-427b-bef6-d0aa9a08d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.475119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602ce4-7d25-427b-bef6-d0aa9a08d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.491183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-92602ce4-7d25-427b-bef6-d0aa9a08d0c5 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:59.492447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-92602ce4-7d25-427b-bef6-d0aa9a08d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:59.501493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522ce79-04d6-4837-a81a-b091e956710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.502696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ce79-04d6-4837-a81a-b091e956710a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.503037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ce79-04d6-4837-a81a-b091e956710a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.503334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ce79-04d6-4837-a81a-b091e956710a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.514618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522ce79-04d6-4837-a81a-b091e956710a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:59.516141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522ce79-04d6-4837-a81a-b091e956710a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-9522ce79-04d6-4837-a81a-b091e956710a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:59.530804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:59.531805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:59.532716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:59.532716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:59.532716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:40:59.536704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 394/797] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:59.537438 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522ce79-04d6-4837-a81a-b091e956710a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:59.567277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 404/798] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:40:59.567277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92602ce4-7d25-427b-bef6-d0aa9a08d0c5 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:59.601994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:59.666863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522ce79-04d6-4837-a81a-b091e956710a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.681075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92602ce4-7d25-427b-bef6-d0aa9a08d0c5 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.693583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:59.702928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487378a1-51ce-4654-afe2-c9efaeab5497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.703558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487378a1-51ce-4654-afe2-c9efaeab5497 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.703847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487378a1-51ce-4654-afe2-c9efaeab5497 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.704096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487378a1-51ce-4654-afe2-c9efaeab5497 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.705291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487378a1-51ce-4654-afe2-c9efaeab5497 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:59.705788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487378a1-51ce-4654-afe2-c9efaeab5497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:59.707261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487378a1-51ce-4654-afe2-c9efaeab5497 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:59.716926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 395/799] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 19:40:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:59.716926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487378a1-51ce-4654-afe2-c9efaeab5497 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:59.722896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf8362-4aa3-43e5-b3f5-19564bd3c838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.723559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8362-4aa3-43e5-b3f5-19564bd3c838 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.723834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8362-4aa3-43e5-b3f5-19564bd3c838 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.724099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8362-4aa3-43e5-b3f5-19564bd3c838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.734879 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf8362-4aa3-43e5-b3f5-19564bd3c838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:59.737181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf8362-4aa3-43e5-b3f5-19564bd3c838 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-18cf8362-4aa3-43e5-b3f5-19564bd3c838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:40:59.752840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:40:59.753799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:40:59.754959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:40:59.754959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:40:59.754959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:40:59.754959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 405/800] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:40:59.755721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0abeb-d78c-4a9a-9365-a2d99c151f3e None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.756010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0abeb-d78c-4a9a-9365-a2d99c151f3e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.756378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0abeb-d78c-4a9a-9365-a2d99c151f3e None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.761608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 406/801] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:40:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:40:59.762382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0abeb-d78c-4a9a-9365-a2d99c151f3e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:59.831248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487378a1-51ce-4654-afe2-c9efaeab5497 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.839295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:59.866177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0abeb-d78c-4a9a-9365-a2d99c151f3e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:40:59.867922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e52801-e432-48b4-95c8-a94fdf1569be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.868563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e52801-e432-48b4-95c8-a94fdf1569be None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.868870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e52801-e432-48b4-95c8-a94fdf1569be None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.869109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e52801-e432-48b4-95c8-a94fdf1569be None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.869750 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e52801-e432-48b4-95c8-a94fdf1569be None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:59.870047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e52801-e432-48b4-95c8-a94fdf1569be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:59.871440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e52801-e432-48b4-95c8-a94fdf1569be None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:59.883192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 396/802] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:59.884004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e52801-e432-48b4-95c8-a94fdf1569be None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:40:59.903363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8429b1c-4dc4-452e-a683-7f039a31317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:40:59.903996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429b1c-4dc4-452e-a683-7f039a31317c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.904333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429b1c-4dc4-452e-a683-7f039a31317c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.904609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429b1c-4dc4-452e-a683-7f039a31317c None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.905269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429b1c-4dc4-452e-a683-7f039a31317c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:40:59.905572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429b1c-4dc4-452e-a683-7f039a31317c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:40:59.906937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429b1c-4dc4-452e-a683-7f039a31317c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:40:59.912778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 407/803] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Aug 22 19:40:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:40:59.913942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c6a68-a6ff-46a2-a69d-509f52f3fc92 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:40:59.914226 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c6a68-a6ff-46a2-a69d-509f52f3fc92 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:40:59.914498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c6a68-a6ff-46a2-a69d-509f52f3fc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:40:59.933061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e05c6a68-a6ff-46a2-a69d-509f52f3fc92 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:40:59.934242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e05c6a68-a6ff-46a2-a69d-509f52f3fc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:40:59.940065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:40:59.991732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e52801-e432-48b4-95c8-a94fdf1569be None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.000037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 408/804] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:40:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:00.000874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c6a68-a6ff-46a2-a69d-509f52f3fc92 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.037963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151621-77d3-4bef-bbc6-dd27364e93ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.038556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151621-77d3-4bef-bbc6-dd27364e93ac None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.038828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151621-77d3-4bef-bbc6-dd27364e93ac None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.039094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6151621-77d3-4bef-bbc6-dd27364e93ac None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.039760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151621-77d3-4bef-bbc6-dd27364e93ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:00.040056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151621-77d3-4bef-bbc6-dd27364e93ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.041415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6151621-77d3-4bef-bbc6-dd27364e93ac None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:00.054472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 397/805] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:00.055106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151621-77d3-4bef-bbc6-dd27364e93ac None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.076489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:00.111902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c6a68-a6ff-46a2-a69d-509f52f3fc92 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.149128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59ebe9-c59e-4550-8362-43fa495806de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.149684 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59ebe9-c59e-4550-8362-43fa495806de None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.149958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59ebe9-c59e-4550-8362-43fa495806de None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.150225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59ebe9-c59e-4550-8362-43fa495806de None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.162179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59ebe9-c59e-4550-8362-43fa495806de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-ee59ebe9-c59e-4550-8362-43fa495806de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:00.166803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:00.167847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:00.168785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 409/806] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:41:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:00.169541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59ebe9-c59e-4550-8362-43fa495806de None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.170822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6151621-77d3-4bef-bbc6-dd27364e93ac None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.184095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:00.211423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38d5af-dc6b-4e78-9351-4bb9c045e628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.212057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38d5af-dc6b-4e78-9351-4bb9c045e628 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.212690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38d5af-dc6b-4e78-9351-4bb9c045e628 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.213722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38d5af-dc6b-4e78-9351-4bb9c045e628 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.222550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38d5af-dc6b-4e78-9351-4bb9c045e628 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.224488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38d5af-dc6b-4e78-9351-4bb9c045e628 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-1e38d5af-dc6b-4e78-9351-4bb9c045e628 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:00.239463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:00.240356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:00.241255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:00.241255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:00.241255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:00.241255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:00.241255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:00.241255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:00.241255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:00.241255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:00.241709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 398/807] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:00.242375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38d5af-dc6b-4e78-9351-4bb9c045e628 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.278896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59ebe9-c59e-4550-8362-43fa495806de None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.305849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:00.313908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fd20-3122-443d-ba65-0ba1fc0ffd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.315125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fd20-3122-443d-ba65-0ba1fc0ffd7f None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.315426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fd20-3122-443d-ba65-0ba1fc0ffd7f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.315693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493fd20-3122-443d-ba65-0ba1fc0ffd7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.316348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493fd20-3122-443d-ba65-0ba1fc0ffd7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.317713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493fd20-3122-443d-ba65-0ba1fc0ffd7f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:00.346530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38d5af-dc6b-4e78-9351-4bb9c045e628 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.381706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbf101-0af8-44de-87fb-37e2902bc21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.382320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf101-0af8-44de-87fb-37e2902bc21d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.382594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf101-0af8-44de-87fb-37e2902bc21d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.382862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf101-0af8-44de-87fb-37e2902bc21d None admin] PATH_INFO: `/v3/users/nova` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.389795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbf101-0af8-44de-87fb-37e2902bc21d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.391291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbf101-0af8-44de-87fb-37e2902bc21d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-91dbf101-0af8-44de-87fb-37e2902bc21d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:00.406366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:00.407566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 399/808] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 19:41:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:00.408936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbf101-0af8-44de-87fb-37e2902bc21d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.447257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 410/809] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:41:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:00.447257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fd20-3122-443d-ba65-0ba1fc0ffd7f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.447568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:00.527392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbf101-0af8-44de-87fb-37e2902bc21d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.568894 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493fd20-3122-443d-ba65-0ba1fc0ffd7f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.570369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9d9b4-1051-4c53-81a2-386ddf5a8ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.570987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9d9b4-1051-4c53-81a2-386ddf5a8ee5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.571279 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9d9b4-1051-4c53-81a2-386ddf5a8ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.571552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9d9b4-1051-4c53-81a2-386ddf5a8ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.572217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9d9b4-1051-4c53-81a2-386ddf5a8ee5 None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:00.572517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9d9b4-1051-4c53-81a2-386ddf5a8ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.573898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9d9b4-1051-4c53-81a2-386ddf5a8ee5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:00.584543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 400/810] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:41:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:00.585379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9d9b4-1051-4c53-81a2-386ddf5a8ee5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.607704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364553ce-cfc3-4810-a410-7037b6f4b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.608575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364553ce-cfc3-4810-a410-7037b6f4b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.609054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364553ce-cfc3-4810-a410-7037b6f4b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.609321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364553ce-cfc3-4810-a410-7037b6f4b8d5 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.610539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364553ce-cfc3-4810-a410-7037b6f4b8d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:00.610539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364553ce-cfc3-4810-a410-7037b6f4b8d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.612005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364553ce-cfc3-4810-a410-7037b6f4b8d5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:00.625354 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 411/811] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:00.626137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364553ce-cfc3-4810-a410-7037b6f4b8d5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.675613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:00.693346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:00.705752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9d9b4-1051-4c53-81a2-386ddf5a8ee5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.736858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364553ce-cfc3-4810-a410-7037b6f4b8d5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.742212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabb02e-e79c-4baf-acb3-69e87a46e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.742858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabb02e-e79c-4baf-acb3-69e87a46e627 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.743115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabb02e-e79c-4baf-acb3-69e87a46e627 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.743414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabb02e-e79c-4baf-acb3-69e87a46e627 None admin] PATH_INFO: `/v3/services/network` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.743999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabb02e-e79c-4baf-acb3-69e87a46e627 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.745358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabb02e-e79c-4baf-acb3-69e87a46e627 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-caabb02e-e79c-4baf-acb3-69e87a46e627 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:00.755182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:00.756427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:00.757449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 401/812] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:00 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:00.758369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabb02e-e79c-4baf-acb3-69e87a46e627 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.785909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7681-e924-40f7-bbc0-1d514e536257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.786523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7681-e924-40f7-bbc0-1d514e536257 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.786810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7681-e924-40f7-bbc0-1d514e536257 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.787076 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7681-e924-40f7-bbc0-1d514e536257 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.787836 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c7681-e924-40f7-bbc0-1d514e536257 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:00.788140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c7681-e924-40f7-bbc0-1d514e536257 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.789561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c7681-e924-40f7-bbc0-1d514e536257 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:00.808914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 412/813] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 19:41:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:00.812095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7681-e924-40f7-bbc0-1d514e536257 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.865479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabb02e-e79c-4baf-acb3-69e87a46e627 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.901774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676514c-fd55-4c55-aefe-ea64de468d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.902427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676514c-fd55-4c55-aefe-ea64de468d18 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.902702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676514c-fd55-4c55-aefe-ea64de468d18 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.902971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676514c-fd55-4c55-aefe-ea64de468d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.914679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676514c-fd55-4c55-aefe-ea64de468d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.915514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:00.916166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676514c-fd55-4c55-aefe-ea64de468d18 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:00.919583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7681-e924-40f7-bbc0-1d514e536257 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-0676514c-fd55-4c55-aefe-ea64de468d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:00.931464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:00.932409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:00.933313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:00.933313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:00.933313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:00.933313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 402/814] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:00.933981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676514c-fd55-4c55-aefe-ea64de468d18 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:00.938402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:00.963547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295347ab-b70b-44de-bc61-15f5631caeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:00.964213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295347ab-b70b-44de-bc61-15f5631caeca None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:00.964491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295347ab-b70b-44de-bc61-15f5631caeca None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:00.964764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295347ab-b70b-44de-bc61-15f5631caeca None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/5a1eeb59bfa24e4bb6658aa4bb5f7852/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:00.966703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295347ab-b70b-44de-bc61-15f5631caeca None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=5a1eeb59bfa24e4bb6658aa4bb5f7852, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:00.968172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295347ab-b70b-44de-bc61-15f5631caeca None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:01.038547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676514c-fd55-4c55-aefe-ea64de468d18 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:01.045668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 413/815] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:41:00 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/5a1eeb59bfa24e4bb6658aa4bb5f7852/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:41:01.047071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295347ab-b70b-44de-bc61-15f5631caeca None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:01.078519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0cb3-9704-4aaa-acd0-40614980fff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:01.080263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0cb3-9704-4aaa-acd0-40614980fff4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:01.080755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0cb3-9704-4aaa-acd0-40614980fff4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:01.081176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0cb3-9704-4aaa-acd0-40614980fff4 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:01.082094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d0cb3-9704-4aaa-acd0-40614980fff4 None admin] RBAC: Adding query filter params (name=network) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:01.082542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d0cb3-9704-4aaa-acd0-40614980fff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:01.084181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d0cb3-9704-4aaa-acd0-40614980fff4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:01.090299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 403/816] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:41:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:01.091859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0cb3-9704-4aaa-acd0-40614980fff4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:01.171113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:01.187093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295347ab-b70b-44de-bc61-15f5631caeca None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:01.210948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0cb3-9704-4aaa-acd0-40614980fff4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:01.230706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0508b-5c59-451a-b71a-fd3bfd7a83d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:01.231362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0508b-5c59-451a-b71a-fd3bfd7a83d5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:01.231634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0508b-5c59-451a-b71a-fd3bfd7a83d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:01.231897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0508b-5c59-451a-b71a-fd3bfd7a83d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:01.252286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6583c24-de5e-4464-a834-0d6b36791b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:01.252935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6583c24-de5e-4464-a834-0d6b36791b4a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:01.253207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6583c24-de5e-4464-a834-0d6b36791b4a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:01.253474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6583c24-de5e-4464-a834-0d6b36791b4a None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:01.254375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6583c24-de5e-4464-a834-0d6b36791b4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:01.254668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6583c24-de5e-4464-a834-0d6b36791b4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:01.256084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6583c24-de5e-4464-a834-0d6b36791b4a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:01.264828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:01.268930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 404/817] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:01.269829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6583c24-de5e-4464-a834-0d6b36791b4a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:01.317081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0508b-5c59-451a-b71a-fd3bfd7a83d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:01.319431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0508b-5c59-451a-b71a-fd3bfd7a83d5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:01.427722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6583c24-de5e-4464-a834-0d6b36791b4a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:01.479413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd528fd-9007-49cf-a792-59a6627245bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:01.479413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd528fd-9007-49cf-a792-59a6627245bc None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:01.479413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd528fd-9007-49cf-a792-59a6627245bc None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:01.479413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd528fd-9007-49cf-a792-59a6627245bc None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:01.479794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd528fd-9007-49cf-a792-59a6627245bc None admin] RBAC: Adding query filter params (type=network) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:01.479794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd528fd-9007-49cf-a792-59a6627245bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:01.479794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd528fd-9007-49cf-a792-59a6627245bc None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:01.480392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 414/818] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:41:01.481907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0508b-5c59-451a-b71a-fd3bfd7a83d5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:01.484394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 405/819] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:41:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:01.489312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd528fd-9007-49cf-a792-59a6627245bc None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:01.489312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:01.553470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:01.624749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd528fd-9007-49cf-a792-59a6627245bc None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:01.625316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0508b-5c59-451a-b71a-fd3bfd7a83d5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:01.662151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656120d8-57f1-4e7c-8ab4-8f04f0331092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:01.663120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656120d8-57f1-4e7c-8ab4-8f04f0331092 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:01.663622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656120d8-57f1-4e7c-8ab4-8f04f0331092 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:01.664177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656120d8-57f1-4e7c-8ab4-8f04f0331092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:01.668933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c32b9-d58d-491f-b247-b52cdc6b8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:01.669561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c32b9-d58d-491f-b247-b52cdc6b8f23 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:01.669838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c32b9-d58d-491f-b247-b52cdc6b8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:01.670104 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c32b9-d58d-491f-b247-b52cdc6b8f23 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:01.678216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656120d8-57f1-4e7c-8ab4-8f04f0331092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:01.679965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656120d8-57f1-4e7c-8ab4-8f04f0331092 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:01.680077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c32b9-d58d-491f-b247-b52cdc6b8f23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:01.681397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c32b9-d58d-491f-b247-b52cdc6b8f23 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-d91c32b9-d58d-491f-b247-b52cdc6b8f23 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:01.695108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:01.696081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:01.697031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 415/820] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:41:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:01.697710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c32b9-d58d-491f-b247-b52cdc6b8f23 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-656120d8-57f1-4e7c-8ab4-8f04f0331092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:01.699205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:01.700145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:01.701025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:01.701025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:01.701025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:01.708099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 406/821] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:01.709176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656120d8-57f1-4e7c-8ab4-8f04f0331092 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:01.757879 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:01.815857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656120d8-57f1-4e7c-8ab4-8f04f0331092 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:01.816564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c32b9-d58d-491f-b247-b52cdc6b8f23 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:01.835689 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:01.853807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c15f2-2b20-4151-b917-3e48fd28cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:01.854886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c15f2-2b20-4151-b917-3e48fd28cc50 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:01.858310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c15f2-2b20-4151-b917-3e48fd28cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:01.858310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c15f2-2b20-4151-b917-3e48fd28cc50 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:01.858310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c15f2-2b20-4151-b917-3e48fd28cc50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:01.858588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee523-eeb0-45d8-b5c1-9e184e8a0a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:01.858682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c15f2-2b20-4151-b917-3e48fd28cc50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:01.858756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee523-eeb0-45d8-b5c1-9e184e8a0a95 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:01.858756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee523-eeb0-45d8-b5c1-9e184e8a0a95 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:01.858756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee523-eeb0-45d8-b5c1-9e184e8a0a95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:01.858756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ee523-eeb0-45d8-b5c1-9e184e8a0a95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:01.859009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c15f2-2b20-4151-b917-3e48fd28cc50 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:01.859757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ee523-eeb0-45d8-b5c1-9e184e8a0a95 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:01.880381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 407/822] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 19:41:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:01.881320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c15f2-2b20-4151-b917-3e48fd28cc50 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:01.953870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 416/823] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:41:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:01.955719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee523-eeb0-45d8-b5c1-9e184e8a0a95 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:01.989362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c15f2-2b20-4151-b917-3e48fd28cc50 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:01.997874 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:02.035858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf72a08-dd5e-45e6-96a0-9ea9eb999d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:02.036385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf72a08-dd5e-45e6-96a0-9ea9eb999d25 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.036713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf72a08-dd5e-45e6-96a0-9ea9eb999d25 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.036989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf72a08-dd5e-45e6-96a0-9ea9eb999d25 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.037628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf72a08-dd5e-45e6-96a0-9ea9eb999d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:02.037927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf72a08-dd5e-45e6-96a0-9ea9eb999d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:02.039449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf72a08-dd5e-45e6-96a0-9ea9eb999d25 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:02.052301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 408/824] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:02.058012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf72a08-dd5e-45e6-96a0-9ea9eb999d25 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:02.174735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee523-eeb0-45d8-b5c1-9e184e8a0a95 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:02.215311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf72a08-dd5e-45e6-96a0-9ea9eb999d25 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:02.238912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4478e0-f028-455c-bb04-40bdb115e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:02.239622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4478e0-f028-455c-bb04-40bdb115e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.239896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4478e0-f028-455c-bb04-40bdb115e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.240162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4478e0-f028-455c-bb04-40bdb115e1c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.252888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4478e0-f028-455c-bb04-40bdb115e1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:02.254708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4478e0-f028-455c-bb04-40bdb115e1c0 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:02.261833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fefb5-7670-4faf-bcf4-e54f41ae50e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:02.262475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fefb5-7670-4faf-bcf4-e54f41ae50e3 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.262753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fefb5-7670-4faf-bcf4-e54f41ae50e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.263027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fefb5-7670-4faf-bcf4-e54f41ae50e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.270280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fefb5-7670-4faf-bcf4-e54f41ae50e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-3d4478e0-f028-455c-bb04-40bdb115e1c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:02.271142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:02.273333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:02.275480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:02.275480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:02.275480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:02.275863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fefb5-7670-4faf-bcf4-e54f41ae50e3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:02.277800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 417/825] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:02.279258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4478e0-f028-455c-bb04-40bdb115e1c0 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-c09fefb5-7670-4faf-bcf4-e54f41ae50e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:02.285820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:02.287906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:02.290167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:02.290167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:02.290167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:02.290167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:02.290167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:02.290167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:02.290167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:02.290167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:02.290167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 409/826] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:02.295274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fefb5-7670-4faf-bcf4-e54f41ae50e3 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:02.310014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:02.315493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:02.391841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4478e0-f028-455c-bb04-40bdb115e1c0 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:02.407130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fefb5-7670-4faf-bcf4-e54f41ae50e3 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:02.440053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a20f22-f090-468c-b99d-cb40ab79e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:02.440695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a20f22-f090-468c-b99d-cb40ab79e725 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.440972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a20f22-f090-468c-b99d-cb40ab79e725 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.441242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a20f22-f090-468c-b99d-cb40ab79e725 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.441897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a20f22-f090-468c-b99d-cb40ab79e725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:02.442194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a20f22-f090-468c-b99d-cb40ab79e725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:02.444138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a20f22-f090-468c-b99d-cb40ab79e725 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:02.461459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3dbff-45b8-4f03-b561-98101e1aa4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:02.461875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 418/827] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:02.462283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3dbff-45b8-4f03-b561-98101e1aa4ed None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.462448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3dbff-45b8-4f03-b561-98101e1aa4ed None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.462718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3dbff-45b8-4f03-b561-98101e1aa4ed None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.463092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a20f22-f090-468c-b99d-cb40ab79e725 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:02.463691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3dbff-45b8-4f03-b561-98101e1aa4ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:02.464001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3dbff-45b8-4f03-b561-98101e1aa4ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:02.465495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3dbff-45b8-4f03-b561-98101e1aa4ed None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:02.482661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 410/828] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:02.484040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd75c9f-6ea5-429d-aed3-d0933b506731 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.484226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd75c9f-6ea5-429d-aed3-d0933b506731 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.484560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd75c9f-6ea5-429d-aed3-d0933b506731 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.487424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 411/829] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:02.492045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd75c9f-6ea5-429d-aed3-d0933b506731 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:02.568682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:02.582984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:02.584663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a20f22-f090-468c-b99d-cb40ab79e725 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:02.606074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd75c9f-6ea5-429d-aed3-d0933b506731 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:02.622533 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5b17a-1e07-4702-8f32-ccc3085dbe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:02.623170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5b17a-1e07-4702-8f32-ccc3085dbe31 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.623481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5b17a-1e07-4702-8f32-ccc3085dbe31 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.623755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5b17a-1e07-4702-8f32-ccc3085dbe31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.631823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5b17a-1e07-4702-8f32-ccc3085dbe31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:02.633282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5b17a-1e07-4702-8f32-ccc3085dbe31 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:02.643761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d540f-8667-4122-aed8-8ded3cd9b402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:02.644365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d540f-8667-4122-aed8-8ded3cd9b402 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.644640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d540f-8667-4122-aed8-8ded3cd9b402 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.644910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d540f-8667-4122-aed8-8ded3cd9b402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-44b5b17a-1e07-4702-8f32-ccc3085dbe31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:02.645006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:02.645840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:02.651943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:02.651943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:02.651943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:02.651943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:02.651943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:02.651943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:02.651943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:02.651943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:02.652391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d540f-8667-4122-aed8-8ded3cd9b402 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1787fcb6f7c34de59c9682a4d8c3d2a3) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:02.652391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d540f-8667-4122-aed8-8ded3cd9b402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:02.652526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 419/830] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:02.652595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d540f-8667-4122-aed8-8ded3cd9b402 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:02.652669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9153c2-49ff-43aa-bb4c-56d7d6bd3cdf None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.652669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9153c2-49ff-43aa-bb4c-56d7d6bd3cdf None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.652669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9153c2-49ff-43aa-bb4c-56d7d6bd3cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.667292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 412/831] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:02 2022] GET /identity/v3/role_assignments?user.id=1787fcb6f7c34de59c9682a4d8c3d2a3&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=9ec7f759c0a64655b794dfb597930076 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:02.667292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d540f-8667-4122-aed8-8ded3cd9b402 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:02.675182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0a9153c2-49ff-43aa-bb4c-56d7d6bd3cdf None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:02.676714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0a9153c2-49ff-43aa-bb4c-56d7d6bd3cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:02.778367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 420/832] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:02.802581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d540f-8667-4122-aed8-8ded3cd9b402 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:02.840014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c5577-48f2-448c-8905-ce09bf124ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:02.840907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c5577-48f2-448c-8905-ce09bf124ae9 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:02.841372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c5577-48f2-448c-8905-ce09bf124ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:02.841825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c5577-48f2-448c-8905-ce09bf124ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:02.842713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c5577-48f2-448c-8905-ce09bf124ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:02.843196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c5577-48f2-448c-8905-ce09bf124ae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:02.844838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c5577-48f2-448c-8905-ce09bf124ae9 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:02.858705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 413/833] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:02.865091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9153c2-49ff-43aa-bb4c-56d7d6bd3cdf None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:02.977415 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:02.990359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9153c2-49ff-43aa-bb4c-56d7d6bd3cdf None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:03.028081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc3943-1bd5-4e62-8f2b-a30401819710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:03.028700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3943-1bd5-4e62-8f2b-a30401819710 None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:03.028990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3943-1bd5-4e62-8f2b-a30401819710 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:03.029270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3943-1bd5-4e62-8f2b-a30401819710 None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/2e09e41723f5430aad58bbca945d1447/roles/4f4fe296a2c34480b2b25ce307b326e6` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:03.044687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc3943-1bd5-4e62-8f2b-a30401819710 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=2e09e41723f5430aad58bbca945d1447, role_id=4f4fe296a2c34480b2b25ce307b326e6)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:03.046154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc3943-1bd5-4e62-8f2b-a30401819710 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:03.084402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c5577-48f2-448c-8905-ce09bf124ae9 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:03.089288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:03.139109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 421/834] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:41:02 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/2e09e41723f5430aad58bbca945d1447/roles/4f4fe296a2c34480b2b25ce307b326e6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:41:03.175804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a4e85-f40c-405b-a9d4-5420da16b93d None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:03.176838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a4e85-f40c-405b-a9d4-5420da16b93d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:03.178167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a4e85-f40c-405b-a9d4-5420da16b93d None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:03.188432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 422/835] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:03 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:03.194550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94595f7-c63f-4bbf-875f-b38765167286 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:03.194843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94595f7-c63f-4bbf-875f-b38765167286 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:03.195262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94595f7-c63f-4bbf-875f-b38765167286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:03.224024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c5577-48f2-448c-8905-ce09bf124ae9 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:03.260358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f94595f7-c63f-4bbf-875f-b38765167286 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:03.261770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f94595f7-c63f-4bbf-875f-b38765167286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:03.270304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee57fa-2844-425c-97a0-06b4f871acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:03.271012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee57fa-2844-425c-97a0-06b4f871acd9 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:03.271326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee57fa-2844-425c-97a0-06b4f871acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:03.271613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee57fa-2844-425c-97a0-06b4f871acd9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:03.272205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee57fa-2844-425c-97a0-06b4f871acd9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:03.273910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee57fa-2844-425c-97a0-06b4f871acd9 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-5dee57fa-2844-425c-97a0-06b4f871acd9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:03.287276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:03.288337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 19:41:03.289188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:03.289942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 414/836] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:41:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:03.301045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee57fa-2844-425c-97a0-06b4f871acd9 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:03.415265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 423/837] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:03.429682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:03.469785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee57fa-2844-425c-97a0-06b4f871acd9 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:03.506567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbceb58-6de4-42c3-91f8-e6d98223b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:03.507449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbceb58-6de4-42c3-91f8-e6d98223b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:03.507926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbceb58-6de4-42c3-91f8-e6d98223b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:03.508380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbceb58-6de4-42c3-91f8-e6d98223b5a7 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:03.509176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbceb58-6de4-42c3-91f8-e6d98223b5a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:03.509663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbceb58-6de4-42c3-91f8-e6d98223b5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:03.511166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbceb58-6de4-42c3-91f8-e6d98223b5a7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:03.516467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 415/838] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:41:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:03.521790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94595f7-c63f-4bbf-875f-b38765167286 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:03.580523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:03.625447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94595f7-c63f-4bbf-875f-b38765167286 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:03.662088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992e3b1-6b7c-41e6-bd52-50fc892c4d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:03.662629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e3b1-6b7c-41e6-bd52-50fc892c4d2e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:03.663268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e3b1-6b7c-41e6-bd52-50fc892c4d2e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:03.663673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992e3b1-6b7c-41e6-bd52-50fc892c4d2e None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:03.664885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992e3b1-6b7c-41e6-bd52-50fc892c4d2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:03.665188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992e3b1-6b7c-41e6-bd52-50fc892c4d2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:03.666554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992e3b1-6b7c-41e6-bd52-50fc892c4d2e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:03.671635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 424/839] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:41:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:03.698315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbceb58-6de4-42c3-91f8-e6d98223b5a7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:03.825128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbceb58-6de4-42c3-91f8-e6d98223b5a7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:03.855946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:03.862659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f18e4-866a-45dd-8fe5-d07999c629f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:03.863319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f18e4-866a-45dd-8fe5-d07999c629f9 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:03.863664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f18e4-866a-45dd-8fe5-d07999c629f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:03.863936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f18e4-866a-45dd-8fe5-d07999c629f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:03.876324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f18e4-866a-45dd-8fe5-d07999c629f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-000f18e4-866a-45dd-8fe5-d07999c629f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:03.881602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:03.882536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:03.883423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 416/840] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:03.888849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992e3b1-6b7c-41e6-bd52-50fc892c4d2e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:03.999018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992e3b1-6b7c-41e6-bd52-50fc892c4d2e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:04.021224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:04.035446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea2f99-b85d-4edc-a04b-3ac0872e6a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:04.036055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea2f99-b85d-4edc-a04b-3ac0872e6a26 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:04.036326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea2f99-b85d-4edc-a04b-3ac0872e6a26 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:04.036594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea2f99-b85d-4edc-a04b-3ac0872e6a26 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:04.037319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea2f99-b85d-4edc-a04b-3ac0872e6a26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:04.037622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea2f99-b85d-4edc-a04b-3ac0872e6a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:04.038978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea2f99-b85d-4edc-a04b-3ac0872e6a26 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:04.047850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 425/841] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:04.054201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f18e4-866a-45dd-8fe5-d07999c629f9 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:04.161168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f18e4-866a-45dd-8fe5-d07999c629f9 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:04.198591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448613-e166-440f-b775-2fb9a602ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:04.199239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448613-e166-440f-b775-2fb9a602ff5a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:04.199545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448613-e166-440f-b775-2fb9a602ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:04.199821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448613-e166-440f-b775-2fb9a602ff5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:04.211419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e448613-e166-440f-b775-2fb9a602ff5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:04.212912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e448613-e166-440f-b775-2fb9a602ff5a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-8e448613-e166-440f-b775-2fb9a602ff5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:04.227551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:04.228607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:04.229519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:04.229519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:04.229519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:04.229519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 417/842] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:04.237103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea2f99-b85d-4edc-a04b-3ac0872e6a26 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:04.344338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea2f99-b85d-4edc-a04b-3ac0872e6a26 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:04.382656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11945061-b290-447e-a8fa-7b93472ff35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:04.383342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11945061-b290-447e-a8fa-7b93472ff35b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:04.383625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11945061-b290-447e-a8fa-7b93472ff35b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:04.383959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11945061-b290-447e-a8fa-7b93472ff35b None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:04.384623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11945061-b290-447e-a8fa-7b93472ff35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:04.384974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11945061-b290-447e-a8fa-7b93472ff35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:04.386399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11945061-b290-447e-a8fa-7b93472ff35b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:04.401065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 426/843] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:04.412448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448613-e166-440f-b775-2fb9a602ff5a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:04.463784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:04.523704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448613-e166-440f-b775-2fb9a602ff5a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:04.558258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa33454-8508-40b0-a7da-c11964351160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:04.558891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33454-8508-40b0-a7da-c11964351160 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:04.559166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33454-8508-40b0-a7da-c11964351160 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:04.559463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa33454-8508-40b0-a7da-c11964351160 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:04.567773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa33454-8508-40b0-a7da-c11964351160 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:04.569217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa33454-8508-40b0-a7da-c11964351160 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-5aa33454-8508-40b0-a7da-c11964351160 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:04.580931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:04.581900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:04.582864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 418/844] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:41:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:04.589923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11945061-b290-447e-a8fa-7b93472ff35b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:04.637606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:04.704327 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11945061-b290-447e-a8fa-7b93472ff35b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:04.741074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1de4c3-5e63-41c4-b5f0-0a53defa71ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:04.741690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1de4c3-5e63-41c4-b5f0-0a53defa71ca None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:04.741967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1de4c3-5e63-41c4-b5f0-0a53defa71ca None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:04.742237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1de4c3-5e63-41c4-b5f0-0a53defa71ca None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:04.742970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1de4c3-5e63-41c4-b5f0-0a53defa71ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:04.743297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1de4c3-5e63-41c4-b5f0-0a53defa71ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:04.744743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1de4c3-5e63-41c4-b5f0-0a53defa71ca None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:04.764093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 427/845] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Aug 22 19:41:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:04.770781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa33454-8508-40b0-a7da-c11964351160 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:04.859317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2ef58-03d1-4c92-aeb3-715e13aec88b None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:04.859606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2ef58-03d1-4c92-aeb3-715e13aec88b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:04.859884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2ef58-03d1-4c92-aeb3-715e13aec88b None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:04.862299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 428/846] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:04.867470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e3f8b-39ee-4c34-b3eb-b652b8ac5caf None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:04.867758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e3f8b-39ee-4c34-b3eb-b652b8ac5caf None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:04.868038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e3f8b-39ee-4c34-b3eb-b652b8ac5caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:04.887083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-643e3f8b-39ee-4c34-b3eb-b652b8ac5caf None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:04.888501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-643e3f8b-39ee-4c34-b3eb-b652b8ac5caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:04.891417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa33454-8508-40b0-a7da-c11964351160 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:04.893543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:04.931137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6facf90-d948-49a6-a2c5-4f03f76d2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:04.932198 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6facf90-d948-49a6-a2c5-4f03f76d2042 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:04.932800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6facf90-d948-49a6-a2c5-4f03f76d2042 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:04.933392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6facf90-d948-49a6-a2c5-4f03f76d2042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:04.983410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 429/847] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:05.016581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6facf90-d948-49a6-a2c5-4f03f76d2042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:05.018786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6facf90-d948-49a6-a2c5-4f03f76d2042 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:05.132715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 419/848] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:41:05.138813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e3f8b-39ee-4c34-b3eb-b652b8ac5caf None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:05.175565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:05.250819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e3f8b-39ee-4c34-b3eb-b652b8ac5caf None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:05.283823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a474854-ba5c-4bf9-a6ed-24af7b8f1096 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.284131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a474854-ba5c-4bf9-a6ed-24af7b8f1096 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.284366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a474854-ba5c-4bf9-a6ed-24af7b8f1096 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.285957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 420/849] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:05.287861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe55a6e-b04e-44ab-a526-3c387dceed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:05.288494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe55a6e-b04e-44ab-a526-3c387dceed86 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.288768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe55a6e-b04e-44ab-a526-3c387dceed86 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.289034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe55a6e-b04e-44ab-a526-3c387dceed86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.291131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce70c6-dbad-435b-8681-292f61e5b5b2 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.291453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce70c6-dbad-435b-8681-292f61e5b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.291727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce70c6-dbad-435b-8681-292f61e5b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.302219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe55a6e-b04e-44ab-a526-3c387dceed86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:05.303718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe55a6e-b04e-44ab-a526-3c387dceed86 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:05.306749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:05.310339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-89ce70c6-dbad-435b-8681-292f61e5b5b2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:05.311578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-89ce70c6-dbad-435b-8681-292f61e5b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-bfe55a6e-b04e-44ab-a526-3c387dceed86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:05.320412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:05.321390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:05.322280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:05.322280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:05.322280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:05.322280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 430/850] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:05.322909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe55a6e-b04e-44ab-a526-3c387dceed86 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:05.385837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 421/851] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:05.394813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce70c6-dbad-435b-8681-292f61e5b5b2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:05.442448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:05.468931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe55a6e-b04e-44ab-a526-3c387dceed86 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:05.508986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce70c6-dbad-435b-8681-292f61e5b5b2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:05.516093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9491fa0-1d3e-4e10-8fa6-be4beecbd67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:05.518189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9491fa0-1d3e-4e10-8fa6-be4beecbd67e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.518710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9491fa0-1d3e-4e10-8fa6-be4beecbd67e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.519668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9491fa0-1d3e-4e10-8fa6-be4beecbd67e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.520514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9491fa0-1d3e-4e10-8fa6-be4beecbd67e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:05.522781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9491fa0-1d3e-4e10-8fa6-be4beecbd67e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-d9491fa0-1d3e-4e10-8fa6-be4beecbd67e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:05.536219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:05.537207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 19:41:05.538124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:05.543269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 431/852] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Aug 22 19:41:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:05.546871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9491fa0-1d3e-4e10-8fa6-be4beecbd67e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:05.548786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:05.557066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64485e-882f-4928-823f-4a871ff87343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:05.557947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64485e-882f-4928-823f-4a871ff87343 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.558825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64485e-882f-4928-823f-4a871ff87343 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.559331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64485e-882f-4928-823f-4a871ff87343 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.560151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64485e-882f-4928-823f-4a871ff87343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:05.560773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64485e-882f-4928-823f-4a871ff87343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:05.562343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64485e-882f-4928-823f-4a871ff87343 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:05.580675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 422/853] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:05.582287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64485e-882f-4928-823f-4a871ff87343 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:05.672658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9491fa0-1d3e-4e10-8fa6-be4beecbd67e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:05.691270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64485e-882f-4928-823f-4a871ff87343 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:05.708288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c1abe-f63b-42f2-8003-a6bf4289df47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:05.708894 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c1abe-f63b-42f2-8003-a6bf4289df47 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.709171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c1abe-f63b-42f2-8003-a6bf4289df47 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.709441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c1abe-f63b-42f2-8003-a6bf4289df47 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.710064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c1abe-f63b-42f2-8003-a6bf4289df47 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:05.710367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c1abe-f63b-42f2-8003-a6bf4289df47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:05.711759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c1abe-f63b-42f2-8003-a6bf4289df47 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:05.716123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 432/854] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:05.716886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c1abe-f63b-42f2-8003-a6bf4289df47 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:05.724239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9e8e0-9002-40b0-b506-ee5c7a256243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:05.724862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e8e0-9002-40b0-b506-ee5c7a256243 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.725135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e8e0-9002-40b0-b506-ee5c7a256243 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.725400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e8e0-9002-40b0-b506-ee5c7a256243 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.729070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:05.732348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9e8e0-9002-40b0-b506-ee5c7a256243 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:05.733840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9e8e0-9002-40b0-b506-ee5c7a256243 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-21d9e8e0-9002-40b0-b506-ee5c7a256243 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:05.745923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:05.746895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 423/855] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:05.748202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a375b-8395-422b-9175-ed72dabab4d5 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.748854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a375b-8395-422b-9175-ed72dabab4d5 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.748854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a375b-8395-422b-9175-ed72dabab4d5 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.749917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 424/856] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:05.750608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a375b-8395-422b-9175-ed72dabab4d5 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:05.805572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:05.824765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c1abe-f63b-42f2-8003-a6bf4289df47 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:05.855598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a375b-8395-422b-9175-ed72dabab4d5 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:05.859742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277b258-a270-4469-ad87-f72e7b617b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:05.860371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277b258-a270-4469-ad87-f72e7b617b99 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.860649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277b258-a270-4469-ad87-f72e7b617b99 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.861569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277b258-a270-4469-ad87-f72e7b617b99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.871605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277b258-a270-4469-ad87-f72e7b617b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-9277b258-a270-4469-ad87-f72e7b617b99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:05.876283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:05.877596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 433/857] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:05.878433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277b258-a270-4469-ad87-f72e7b617b99 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:05.895797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839373cb-8f3a-4feb-9b01-ae3feeed8fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:05.896400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839373cb-8f3a-4feb-9b01-ae3feeed8fc4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.896684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839373cb-8f3a-4feb-9b01-ae3feeed8fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.896957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839373cb-8f3a-4feb-9b01-ae3feeed8fc4 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.897591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839373cb-8f3a-4feb-9b01-ae3feeed8fc4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:05.897892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839373cb-8f3a-4feb-9b01-ae3feeed8fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:05.899398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839373cb-8f3a-4feb-9b01-ae3feeed8fc4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:05.903829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 425/858] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:05.905061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10a2b-d553-4805-9a92-caabba4846d4 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:05.905347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10a2b-d553-4805-9a92-caabba4846d4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:05.905619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10a2b-d553-4805-9a92-caabba4846d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:05.936563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-71c10a2b-d553-4805-9a92-caabba4846d4 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:05.937795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-71c10a2b-d553-4805-9a92-caabba4846d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:05.961488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:05.998568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277b258-a270-4469-ad87-f72e7b617b99 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:06.019500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 426/859] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:06.019500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10a2b-d553-4805-9a92-caabba4846d4 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:06.045549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee069cb7-cf71-4983-b34d-8c11673100c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:06.046513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069cb7-cf71-4983-b34d-8c11673100c7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:06.047084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069cb7-cf71-4983-b34d-8c11673100c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:06.047539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee069cb7-cf71-4983-b34d-8c11673100c7 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:06.048908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee069cb7-cf71-4983-b34d-8c11673100c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:06.049413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee069cb7-cf71-4983-b34d-8c11673100c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:06.051244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee069cb7-cf71-4983-b34d-8c11673100c7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:06.066041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 434/860] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:06.071886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee069cb7-cf71-4983-b34d-8c11673100c7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:06.086627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:06.161607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10a2b-d553-4805-9a92-caabba4846d4 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:06.194698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee069cb7-cf71-4983-b34d-8c11673100c7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:06.207926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28bbd1-c1b4-4617-a9b0-4fdf47ee8aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:06.208550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28bbd1-c1b4-4617-a9b0-4fdf47ee8aa1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:06.208827 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28bbd1-c1b4-4617-a9b0-4fdf47ee8aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:06.209101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28bbd1-c1b4-4617-a9b0-4fdf47ee8aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:06.210072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28bbd1-c1b4-4617-a9b0-4fdf47ee8aa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:06.210379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28bbd1-c1b4-4617-a9b0-4fdf47ee8aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:06.212209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28bbd1-c1b4-4617-a9b0-4fdf47ee8aa1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:06.228563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 427/861] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:41:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:06.230802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28bbd1-c1b4-4617-a9b0-4fdf47ee8aa1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:06.233450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:06.241001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377edc0-b67b-4722-8554-ccb781948c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:06.241673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377edc0-b67b-4722-8554-ccb781948c92 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:06.242070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377edc0-b67b-4722-8554-ccb781948c92 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:06.247324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377edc0-b67b-4722-8554-ccb781948c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:06.247324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377edc0-b67b-4722-8554-ccb781948c92 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=5a1eeb59bfa24e4bb6658aa4bb5f7852) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:06.247324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377edc0-b67b-4722-8554-ccb781948c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:06.247324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377edc0-b67b-4722-8554-ccb781948c92 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:06.255314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 435/862] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:06 2022] GET /identity/v3/role_assignments?user.id=5a1eeb59bfa24e4bb6658aa4bb5f7852&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=9ec7f759c0a64655b794dfb597930076 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:06.293317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377edc0-b67b-4722-8554-ccb781948c92 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:06.364081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28bbd1-c1b4-4617-a9b0-4fdf47ee8aa1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:06.374715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:06.403875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e762a-34f3-45f3-9a1d-6064d2ecb6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:06.404389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e762a-34f3-45f3-9a1d-6064d2ecb6df None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:06.407408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e762a-34f3-45f3-9a1d-6064d2ecb6df None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:06.407408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e762a-34f3-45f3-9a1d-6064d2ecb6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:06.418028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e762a-34f3-45f3-9a1d-6064d2ecb6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:06.419629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e762a-34f3-45f3-9a1d-6064d2ecb6df None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:06.419760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377edc0-b67b-4722-8554-ccb781948c92 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-a71e762a-34f3-45f3-9a1d-6064d2ecb6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:06.437605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:06.438598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:06.440090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:06.440090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:06.440090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:06.440090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 428/863] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:06.446050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e762a-34f3-45f3-9a1d-6064d2ecb6df None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:06.456630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d2d88-ffa7-43bb-a5b8-c43d43efd4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:06.457258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d2d88-ffa7-43bb-a5b8-c43d43efd4d3 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:06.457534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d2d88-ffa7-43bb-a5b8-c43d43efd4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:06.457839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d2d88-ffa7-43bb-a5b8-c43d43efd4d3 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:06.458493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d2d88-ffa7-43bb-a5b8-c43d43efd4d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:06.460044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d2d88-ffa7-43bb-a5b8-c43d43efd4d3 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:06.530703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 436/864] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:41:06 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:41:06.572350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e762a-34f3-45f3-9a1d-6064d2ecb6df None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:06.625064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71e74f-009c-43f7-be3c-98562c6bb765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:06.626038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e74f-009c-43f7-be3c-98562c6bb765 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:06.627215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e74f-009c-43f7-be3c-98562c6bb765 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:06.627854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e74f-009c-43f7-be3c-98562c6bb765 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:06.628740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71e74f-009c-43f7-be3c-98562c6bb765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:06.629516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71e74f-009c-43f7-be3c-98562c6bb765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:06.631107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71e74f-009c-43f7-be3c-98562c6bb765 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:06.646834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 429/865] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:06.652443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d2d88-ffa7-43bb-a5b8-c43d43efd4d3 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:06.717716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:06.768360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d2d88-ffa7-43bb-a5b8-c43d43efd4d3 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:06.804541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24c8ab-497c-42e0-a1f7-05bd382d2478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:06.805170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24c8ab-497c-42e0-a1f7-05bd382d2478 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:06.805444 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24c8ab-497c-42e0-a1f7-05bd382d2478 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:06.805707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24c8ab-497c-42e0-a1f7-05bd382d2478 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:06.813604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24c8ab-497c-42e0-a1f7-05bd382d2478 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:06.815299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24c8ab-497c-42e0-a1f7-05bd382d2478 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-9e24c8ab-497c-42e0-a1f7-05bd382d2478 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:06.827004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:06.828178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:06.829373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 437/866] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:41:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:06.835848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71e74f-009c-43f7-be3c-98562c6bb765 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:06.855625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:06.943508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71e74f-009c-43f7-be3c-98562c6bb765 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:06.980223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05bf97-8b2e-4c76-81d7-6f6f0fe4915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:06.980756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05bf97-8b2e-4c76-81d7-6f6f0fe4915f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:06.981085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05bf97-8b2e-4c76-81d7-6f6f0fe4915f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:06.981357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05bf97-8b2e-4c76-81d7-6f6f0fe4915f None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:06.982138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05bf97-8b2e-4c76-81d7-6f6f0fe4915f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:06.982442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05bf97-8b2e-4c76-81d7-6f6f0fe4915f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:06.983981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05bf97-8b2e-4c76-81d7-6f6f0fe4915f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:07.002246 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 430/867] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 19:41:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:07.008548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24c8ab-497c-42e0-a1f7-05bd382d2478 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:07.117464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24c8ab-497c-42e0-a1f7-05bd382d2478 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:07.132359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:07.153652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb3d31-6fd1-453c-a6a9-1dc98aa50e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:07.154256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb3d31-6fd1-453c-a6a9-1dc98aa50e5a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:07.154533 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb3d31-6fd1-453c-a6a9-1dc98aa50e5a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:07.154803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb3d31-6fd1-453c-a6a9-1dc98aa50e5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:07.224563 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb3d31-6fd1-453c-a6a9-1dc98aa50e5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:07.226035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb3d31-6fd1-453c-a6a9-1dc98aa50e5a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:07.334644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 438/868] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:07 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:41:07.335984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05bf97-8b2e-4c76-81d7-6f6f0fe4915f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:07.417886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:07.444129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05bf97-8b2e-4c76-81d7-6f6f0fe4915f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:07.480915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7a72-2e21-42dd-a3d0-5ce1ffc12445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:07.481541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7a72-2e21-42dd-a3d0-5ce1ffc12445 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:07.481812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7a72-2e21-42dd-a3d0-5ce1ffc12445 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:07.482079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d7a72-2e21-42dd-a3d0-5ce1ffc12445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:07.493250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d7a72-2e21-42dd-a3d0-5ce1ffc12445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:07.494698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d7a72-2e21-42dd-a3d0-5ce1ffc12445 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-db3d7a72-2e21-42dd-a3d0-5ce1ffc12445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:07.509596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:07.510555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:07.511459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:07.511459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:07.511459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:07.511459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 431/869] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:07.517136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb3d31-6fd1-453c-a6a9-1dc98aa50e5a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:07.533447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:07.623236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb3d31-6fd1-453c-a6a9-1dc98aa50e5a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:07.661064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50713191-b6c9-4dbf-aa9d-063e8b6223c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:07.661680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50713191-b6c9-4dbf-aa9d-063e8b6223c7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:07.661960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50713191-b6c9-4dbf-aa9d-063e8b6223c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:07.662298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50713191-b6c9-4dbf-aa9d-063e8b6223c7 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:07.662958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50713191-b6c9-4dbf-aa9d-063e8b6223c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:07.663286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50713191-b6c9-4dbf-aa9d-063e8b6223c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:07.664797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50713191-b6c9-4dbf-aa9d-063e8b6223c7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:07.682188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 439/870] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:07.684313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7a72-2e21-42dd-a3d0-5ce1ffc12445 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:07.794224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d7a72-2e21-42dd-a3d0-5ce1ffc12445 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:07.822758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:07.832397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59f22f-ad17-4766-9628-5733b3216323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:07.833026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59f22f-ad17-4766-9628-5733b3216323 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:07.833301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59f22f-ad17-4766-9628-5733b3216323 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:07.833568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59f22f-ad17-4766-9628-5733b3216323 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:07.840833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59f22f-ad17-4766-9628-5733b3216323 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59f22f-ad17-4766-9628-5733b3216323 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-1d59f22f-ad17-4766-9628-5733b3216323 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:07.865456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:07.866445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:07.867554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 432/871] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:07.868255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50713191-b6c9-4dbf-aa9d-063e8b6223c7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:07.949807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:07.975550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50713191-b6c9-4dbf-aa9d-063e8b6223c7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:07.994393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79281c-29d5-4e7f-8de6-7e39c64849a4 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:07.994716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79281c-29d5-4e7f-8de6-7e39c64849a4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:07.994932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79281c-29d5-4e7f-8de6-7e39c64849a4 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:07.996418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 433/872] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:08.002821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f90c-d67c-4727-8c6c-6bc7b2742a29 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.003508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f90c-d67c-4727-8c6c-6bc7b2742a29 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.004387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f90c-d67c-4727-8c6c-6bc7b2742a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.012039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66760df-d3da-49bf-9405-18911fe564f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:08.012647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66760df-d3da-49bf-9405-18911fe564f7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.012926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66760df-d3da-49bf-9405-18911fe564f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.013196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66760df-d3da-49bf-9405-18911fe564f7 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.013891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66760df-d3da-49bf-9405-18911fe564f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:08.014198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66760df-d3da-49bf-9405-18911fe564f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:08.015682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66760df-d3da-49bf-9405-18911fe564f7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:08.024988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fb76f90c-d67c-4727-8c6c-6bc7b2742a29 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:08.026412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fb76f90c-d67c-4727-8c6c-6bc7b2742a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:08.028478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 440/873] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:08.034429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66760df-d3da-49bf-9405-18911fe564f7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:08.114984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 434/874] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:08.146195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66760df-d3da-49bf-9405-18911fe564f7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:08.181588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985618c9-fc8c-47a2-bd89-118ff979bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:08.182947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985618c9-fc8c-47a2-bd89-118ff979bf88 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.183252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985618c9-fc8c-47a2-bd89-118ff979bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.183567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985618c9-fc8c-47a2-bd89-118ff979bf88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.184297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985618c9-fc8c-47a2-bd89-118ff979bf88 None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=2e09e41723f5430aad58bbca945d1447) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:08.184600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985618c9-fc8c-47a2-bd89-118ff979bf88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:08.186086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985618c9-fc8c-47a2-bd89-118ff979bf88 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:08.188010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:08.193452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 441/875] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:08 2022] GET /identity/v3/role_assignments?user.id=2e09e41723f5430aad58bbca945d1447&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:08.258039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff98f-5733-4022-b219-c8235028042f None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.258227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff98f-5733-4022-b219-c8235028042f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.258488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ff98f-5733-4022-b219-c8235028042f None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.260234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 435/876] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:08.266054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87ed05-5d78-43e9-9231-ea4bc4477282 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.266361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87ed05-5d78-43e9-9231-ea4bc4477282 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.266603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87ed05-5d78-43e9-9231-ea4bc4477282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.286931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7d87ed05-5d78-43e9-9231-ea4bc4477282 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:08.288203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7d87ed05-5d78-43e9-9231-ea4bc4477282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:08.362039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 442/877] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:08 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:08.410752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ff98f-5733-4022-b219-c8235028042f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:08.520593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ff98f-5733-4022-b219-c8235028042f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:08.538403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:08.557622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bebe3-7855-40d4-a7cb-5f21c19155fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:08.558553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bebe3-7855-40d4-a7cb-5f21c19155fd None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.558990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bebe3-7855-40d4-a7cb-5f21c19155fd None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.559465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bebe3-7855-40d4-a7cb-5f21c19155fd None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.560308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bebe3-7855-40d4-a7cb-5f21c19155fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:08.561856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bebe3-7855-40d4-a7cb-5f21c19155fd None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:08.635703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87ed05-5d78-43e9-9231-ea4bc4477282 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:08.660856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 436/878] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:41:08 2022] POST /identity/v3/services => generated 269 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:08.750501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366b318-4bca-4682-9a67-5923753f9ea3 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.750878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366b318-4bca-4682-9a67-5923753f9ea3 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.751325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366b318-4bca-4682-9a67-5923753f9ea3 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.754083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 437/879] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:08.756491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87ed05-5d78-43e9-9231-ea4bc4477282 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:08.759870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b330-6715-4b5e-ba6d-822d9f84ad32 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.760158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b330-6715-4b5e-ba6d-822d9f84ad32 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.760440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7b330-6715-4b5e-ba6d-822d9f84ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.780560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-87c7b330-6715-4b5e-ba6d-822d9f84ad32 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:08.781722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-87c7b330-6715-4b5e-ba6d-822d9f84ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:08.788832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:08.804407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bca4ab-b8cc-4a32-b7fd-cdbc30b680a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:08.813864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca4ab-b8cc-4a32-b7fd-cdbc30b680a7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.813864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca4ab-b8cc-4a32-b7fd-cdbc30b680a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.813864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca4ab-b8cc-4a32-b7fd-cdbc30b680a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.813864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bca4ab-b8cc-4a32-b7fd-cdbc30b680a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:08.813864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bca4ab-b8cc-4a32-b7fd-cdbc30b680a7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-12bca4ab-b8cc-4a32-b7fd-cdbc30b680a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:08.817918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:08.818885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:08.819781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:08.822307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 443/880] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:08.830065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bca4ab-b8cc-4a32-b7fd-cdbc30b680a7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:08.867318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 438/881] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:08.944789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bca4ab-b8cc-4a32-b7fd-cdbc30b680a7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:08.981257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578cf95-d490-443e-8c3b-0f7e3e018816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:08.982231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578cf95-d490-443e-8c3b-0f7e3e018816 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:08.982733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578cf95-d490-443e-8c3b-0f7e3e018816 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:08.983204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578cf95-d490-443e-8c3b-0f7e3e018816 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:08.984101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578cf95-d490-443e-8c3b-0f7e3e018816 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:08.984601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578cf95-d490-443e-8c3b-0f7e3e018816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:08.986234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578cf95-d490-443e-8c3b-0f7e3e018816 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:08.991585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 444/882] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:09.000337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7b330-6715-4b5e-ba6d-822d9f84ad32 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:09.106840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7b330-6715-4b5e-ba6d-822d9f84ad32 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:09.115999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:09.144003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fef75-f161-4c35-8c38-45247afbde86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:09.144611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fef75-f161-4c35-8c38-45247afbde86 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:09.144885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fef75-f161-4c35-8c38-45247afbde86 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:09.145213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fef75-f161-4c35-8c38-45247afbde86 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:09.145842 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fef75-f161-4c35-8c38-45247afbde86 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:09.146134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fef75-f161-4c35-8c38-45247afbde86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:09.147558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fef75-f161-4c35-8c38-45247afbde86 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:09.152435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 439/883] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:09.174880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578cf95-d490-443e-8c3b-0f7e3e018816 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:09.242381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:09.296353 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578cf95-d490-443e-8c3b-0f7e3e018816 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:09.334561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebf96-7b5b-41ba-93d4-d9136d7d959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:09.335194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebf96-7b5b-41ba-93d4-d9136d7d959d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:09.335508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebf96-7b5b-41ba-93d4-d9136d7d959d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:09.335781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebf96-7b5b-41ba-93d4-d9136d7d959d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:09.336368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ebf96-7b5b-41ba-93d4-d9136d7d959d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:09.337745 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ebf96-7b5b-41ba-93d4-d9136d7d959d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-b35ebf96-7b5b-41ba-93d4-d9136d7d959d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:09.347178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:09.348486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:09.349760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 445/884] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:41:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:09.354182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fef75-f161-4c35-8c38-45247afbde86 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:09.488352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fef75-f161-4c35-8c38-45247afbde86 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:09.526259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804552-53a4-40f9-a6d3-a6cd1be8761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:09.527162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804552-53a4-40f9-a6d3-a6cd1be8761d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:09.527633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804552-53a4-40f9-a6d3-a6cd1be8761d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:09.528098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17804552-53a4-40f9-a6d3-a6cd1be8761d None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:09.528894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17804552-53a4-40f9-a6d3-a6cd1be8761d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:09.529367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17804552-53a4-40f9-a6d3-a6cd1be8761d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:09.531032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17804552-53a4-40f9-a6d3-a6cd1be8761d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:09.536874 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 440/885] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:41:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:09.542762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebf96-7b5b-41ba-93d4-d9136d7d959d None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:09.652214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebf96-7b5b-41ba-93d4-d9136d7d959d None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:09.669818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:09.688476 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4126831-6dea-48e0-b26c-dc52b2795969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:09.689267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4126831-6dea-48e0-b26c-dc52b2795969 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:09.689547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4126831-6dea-48e0-b26c-dc52b2795969 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:09.689814 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4126831-6dea-48e0-b26c-dc52b2795969 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:09.690451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4126831-6dea-48e0-b26c-dc52b2795969 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:09.690752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4126831-6dea-48e0-b26c-dc52b2795969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:09.692150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4126831-6dea-48e0-b26c-dc52b2795969 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:09.697593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 446/886] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:41:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:09.703497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804552-53a4-40f9-a6d3-a6cd1be8761d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:09.742359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:09.813609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17804552-53a4-40f9-a6d3-a6cd1be8761d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:09.851305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd3c24-097f-4aa6-b7b2-cfa311f00216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:09.852306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3c24-097f-4aa6-b7b2-cfa311f00216 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:09.852806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3c24-097f-4aa6-b7b2-cfa311f00216 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:09.853286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd3c24-097f-4aa6-b7b2-cfa311f00216 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:09.854193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd3c24-097f-4aa6-b7b2-cfa311f00216 None admin] RBAC: Adding query filter params (interface=public, service_id=8021d377e0b64db0b3242fbf8f38398d, region_id=RegionOne) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:09.854699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd3c24-097f-4aa6-b7b2-cfa311f00216 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:09.856350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd3c24-097f-4aa6-b7b2-cfa311f00216 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:09.862350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 441/887] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 19:41:09 2022] GET /identity/v3/endpoints?service_id=8021d377e0b64db0b3242fbf8f38398d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:09.868379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4126831-6dea-48e0-b26c-dc52b2795969 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:09.985363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4126831-6dea-48e0-b26c-dc52b2795969 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:10.026721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb216759-b059-4d4a-9812-6c0d8a97ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:10.027356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216759-b059-4d4a-9812-6c0d8a97ed30 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:10.027635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216759-b059-4d4a-9812-6c0d8a97ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:10.027908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216759-b059-4d4a-9812-6c0d8a97ed30 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:10.028512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb216759-b059-4d4a-9812-6c0d8a97ed30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:10.029866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb216759-b059-4d4a-9812-6c0d8a97ed30 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:10.036185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 447/888] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 19:41:09 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:41:10.344766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e12c6-9685-4df6-8171-d74663e5ca21 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:10.345881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e12c6-9685-4df6-8171-d74663e5ca21 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:10.345881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e12c6-9685-4df6-8171-d74663e5ca21 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:10.347524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 442/889] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:10.353003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700dc81-cf21-48aa-9af7-687b0538f4ba None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:10.353290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700dc81-cf21-48aa-9af7-687b0538f4ba None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:10.353562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700dc81-cf21-48aa-9af7-687b0538f4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:10.372912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c700dc81-cf21-48aa-9af7-687b0538f4ba None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:10.374116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c700dc81-cf21-48aa-9af7-687b0538f4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:10.419983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:10.448665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 448/890] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:10.719591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e12c6-9685-4df6-8171-d74663e5ca21 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:10.743842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6484727-f6bd-4132-9d02-d600969cfbf0 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:10.744125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6484727-f6bd-4132-9d02-d600969cfbf0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:10.744402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6484727-f6bd-4132-9d02-d600969cfbf0 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:10.745752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 449/891] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:10.751082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2756d7-b9c8-43b2-bace-ee5e21846686 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:10.751947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2756d7-b9c8-43b2-bace-ee5e21846686 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:10.752224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2756d7-b9c8-43b2-bace-ee5e21846686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:10.771773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0a2756d7-b9c8-43b2-bace-ee5e21846686 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:10.773065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0a2756d7-b9c8-43b2-bace-ee5e21846686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:10.836177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:10.841352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e12c6-9685-4df6-8171-d74663e5ca21 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:10.855386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 450/892] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:10.878271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34fa87-eaf4-4e70-8076-0ea9f55421ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:10.879515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34fa87-eaf4-4e70-8076-0ea9f55421ee None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:10.880102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34fa87-eaf4-4e70-8076-0ea9f55421ee None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:10.880468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34fa87-eaf4-4e70-8076-0ea9f55421ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:10.891510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34fa87-eaf4-4e70-8076-0ea9f55421ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-be34fa87-eaf4-4e70-8076-0ea9f55421ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:10.896909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:10.897950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:10.898883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 443/893] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 19:41:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:10.904109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2756d7-b9c8-43b2-bace-ee5e21846686 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.008049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2756d7-b9c8-43b2-bace-ee5e21846686 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:11.011183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:11.045475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f180-208a-42fb-9797-b29bbf14e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:11.046095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f180-208a-42fb-9797-b29bbf14e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.046375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f180-208a-42fb-9797-b29bbf14e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.046649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1f180-208a-42fb-9797-b29bbf14e8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.047351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1f180-208a-42fb-9797-b29bbf14e8a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:11.047657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1f180-208a-42fb-9797-b29bbf14e8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:11.049273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1f180-208a-42fb-9797-b29bbf14e8a1 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:11.058872 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 451/894] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 19:41:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:11.065112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34fa87-eaf4-4e70-8076-0ea9f55421ee None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.159857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f180-208a-42fb-9797-b29bbf14e8a1 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.179443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34fa87-eaf4-4e70-8076-0ea9f55421ee None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:11.218163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db3a9d-fe18-46fd-86a1-51d6b588dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:11.218815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db3a9d-fe18-46fd-86a1-51d6b588dafa None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.219092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db3a9d-fe18-46fd-86a1-51d6b588dafa None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.219403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db3a9d-fe18-46fd-86a1-51d6b588dafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.232046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db3a9d-fe18-46fd-86a1-51d6b588dafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:11.233500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db3a9d-fe18-46fd-86a1-51d6b588dafa None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-78db3a9d-fe18-46fd-86a1-51d6b588dafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:11.248635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:11.249745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:11.250632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:11.250632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:11.250632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:11.250632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 444/895] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:11.251836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6294a9-3544-4f25-b97e-52dbbe083fbf None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.252258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6294a9-3544-4f25-b97e-52dbbe083fbf None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.252641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6294a9-3544-4f25-b97e-52dbbe083fbf None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.258315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 445/896] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:11.258315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6294a9-3544-4f25-b97e-52dbbe083fbf None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.274926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:11.289912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1f180-208a-42fb-9797-b29bbf14e8a1 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:11.328083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dca469-d540-46b3-80f0-53b80d50b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:11.328711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dca469-d540-46b3-80f0-53b80d50b1ab None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.328987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dca469-d540-46b3-80f0-53b80d50b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.329254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dca469-d540-46b3-80f0-53b80d50b1ab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.329834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dca469-d540-46b3-80f0-53b80d50b1ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:11.331198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dca469-d540-46b3-80f0-53b80d50b1ab None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-19dca469-d540-46b3-80f0-53b80d50b1ab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:11.341598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:11.342579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:11.343522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 452/897] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Aug 22 19:41:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:11.344579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ceb54-fd40-470f-8f44-260e26cd246a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.345799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ceb54-fd40-470f-8f44-260e26cd246a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.346180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ceb54-fd40-470f-8f44-260e26cd246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.365268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b95ceb54-fd40-470f-8f44-260e26cd246a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:11.366488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b95ceb54-fd40-470f-8f44-260e26cd246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:11.389230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6294a9-3544-4f25-b97e-52dbbe083fbf None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:11.396084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:11.428830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509364d-632c-48d1-8588-187132cbd457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:11.429907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509364d-632c-48d1-8588-187132cbd457 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.430658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509364d-632c-48d1-8588-187132cbd457 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.431036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509364d-632c-48d1-8588-187132cbd457 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.432312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509364d-632c-48d1-8588-187132cbd457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:11.432933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509364d-632c-48d1-8588-187132cbd457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:11.436053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509364d-632c-48d1-8588-187132cbd457 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:11.447111 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 453/898] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:11.448064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ceb54-fd40-470f-8f44-260e26cd246a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.452774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 446/899] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:11.458753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509364d-632c-48d1-8588-187132cbd457 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.549707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:11.576962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ceb54-fd40-470f-8f44-260e26cd246a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:11.589317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509364d-632c-48d1-8588-187132cbd457 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:11.619449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cb5b7-ff71-4f92-8201-37eb0222aef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:11.620539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cb5b7-ff71-4f92-8201-37eb0222aef2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.621050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cb5b7-ff71-4f92-8201-37eb0222aef2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.621659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cb5b7-ff71-4f92-8201-37eb0222aef2 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.622513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cb5b7-ff71-4f92-8201-37eb0222aef2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:11.623017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cb5b7-ff71-4f92-8201-37eb0222aef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:11.624839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cb5b7-ff71-4f92-8201-37eb0222aef2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:11.631397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 454/900] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:11.636539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cb5b7-ff71-4f92-8201-37eb0222aef2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.638396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5557-66f5-4774-a559-987f39711de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:11.639031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5557-66f5-4774-a559-987f39711de4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.639336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5557-66f5-4774-a559-987f39711de4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.639607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5557-66f5-4774-a559-987f39711de4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.650235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac5557-66f5-4774-a559-987f39711de4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:11.651757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac5557-66f5-4774-a559-987f39711de4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-eaac5557-66f5-4774-a559-987f39711de4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:11.668146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:11.669114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:11.670046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:11.671612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:11.674682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 447/901] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:41:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:11.675753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5557-66f5-4774-a559-987f39711de4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.765790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cb5b7-ff71-4f92-8201-37eb0222aef2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:11.801375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5557-66f5-4774-a559-987f39711de4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:11.801550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0a3f-83d2-4554-9d45-a3d75c0c1265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:11.802129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0a3f-83d2-4554-9d45-a3d75c0c1265 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.802404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0a3f-83d2-4554-9d45-a3d75c0c1265 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.802777 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d0a3f-83d2-4554-9d45-a3d75c0c1265 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.803323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0a3f-83d2-4554-9d45-a3d75c0c1265 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:11.803625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0a3f-83d2-4554-9d45-a3d75c0c1265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:11.804992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d0a3f-83d2-4554-9d45-a3d75c0c1265 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:11.814572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 455/902] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:11.814572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0a3f-83d2-4554-9d45-a3d75c0c1265 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.837848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:11.844281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5364ba-8449-45b8-8750-3e6d4e183cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:11.845470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5364ba-8449-45b8-8750-3e6d4e183cd7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.845849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5364ba-8449-45b8-8750-3e6d4e183cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.846137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5364ba-8449-45b8-8750-3e6d4e183cd7 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.846906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5364ba-8449-45b8-8750-3e6d4e183cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:11.847358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5364ba-8449-45b8-8750-3e6d4e183cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:11.855379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5364ba-8449-45b8-8750-3e6d4e183cd7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:11.867418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 448/903] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 19:41:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:11.872826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5364ba-8449-45b8-8750-3e6d4e183cd7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:11.910331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:11.923946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d0a3f-83d2-4554-9d45-a3d75c0c1265 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:11.962637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f233a0-456d-454b-867a-7371eec30eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:11.963265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f233a0-456d-454b-867a-7371eec30eb9 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:11.963549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f233a0-456d-454b-867a-7371eec30eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:11.963818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f233a0-456d-454b-867a-7371eec30eb9 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:11.964473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f233a0-456d-454b-867a-7371eec30eb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:11.965826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f233a0-456d-454b-867a-7371eec30eb9 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:11.981279 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5364ba-8449-45b8-8750-3e6d4e183cd7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:12.016410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495ada-454a-440c-889c-d6d251bb0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:12.017660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495ada-454a-440c-889c-d6d251bb0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.017958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495ada-454a-440c-889c-d6d251bb0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.018294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495ada-454a-440c-889c-d6d251bb0ad5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.018999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495ada-454a-440c-889c-d6d251bb0ad5 None admin] RBAC: Adding query filter params (interface=public, service_id=1caeb190c3d9472384ceafec8d615f57, region_id=RegionOne) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:12.019338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495ada-454a-440c-889c-d6d251bb0ad5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:12.020707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495ada-454a-440c-889c-d6d251bb0ad5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:12.025964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 449/904] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 19:41:11 2022] GET /identity/v3/endpoints?service_id=1caeb190c3d9472384ceafec8d615f57&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:12.026737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495ada-454a-440c-889c-d6d251bb0ad5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:12.030006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 456/905] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:41:11 2022] POST /identity/v3/services => generated 241 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:12.031616 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f233a0-456d-454b-867a-7371eec30eb9 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:12.117644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:12.158489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f233a0-456d-454b-867a-7371eec30eb9 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:12.175024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495ada-454a-440c-889c-d6d251bb0ad5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:12.198655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3faa5-f0b6-4b51-bb7e-164c6af89a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:12.199560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3faa5-f0b6-4b51-bb7e-164c6af89a96 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.199985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3faa5-f0b6-4b51-bb7e-164c6af89a96 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.200413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3faa5-f0b6-4b51-bb7e-164c6af89a96 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.201033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3faa5-f0b6-4b51-bb7e-164c6af89a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:12.202541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3faa5-f0b6-4b51-bb7e-164c6af89a96 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:12.209805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 457/906] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 19:41:12 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:41:12.211269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8d65-6d08-4397-8a30-a290fa6d1fc3 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.211269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8d65-6d08-4397-8a30-a290fa6d1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.218323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e8d65-6d08-4397-8a30-a290fa6d1fc3 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.218323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 458/907] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:12.218624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeab16-c409-48d2-9f11-e7271970beb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:12.218624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeab16-c409-48d2-9f11-e7271970beb2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.218624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeab16-c409-48d2-9f11-e7271970beb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.218624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeab16-c409-48d2-9f11-e7271970beb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.218945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed67acf-5d68-4d85-8b31-b3b4c690081b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.219029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed67acf-5d68-4d85-8b31-b3b4c690081b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.219386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed67acf-5d68-4d85-8b31-b3b4c690081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.246376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6ed67acf-5d68-4d85-8b31-b3b4c690081b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:12.248139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6ed67acf-5d68-4d85-8b31-b3b4c690081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:12.255814 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:12.303513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeab16-c409-48d2-9f11-e7271970beb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:12.305050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeab16-c409-48d2-9f11-e7271970beb2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:12.351298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 459/908] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:12.370108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:12.430067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 450/909] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:12 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:41:12.436764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed67acf-5d68-4d85-8b31-b3b4c690081b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:12.545351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed67acf-5d68-4d85-8b31-b3b4c690081b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:12.582430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072d704-8f24-4cde-b3d8-57b70c3909f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:12.583399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d704-8f24-4cde-b3d8-57b70c3909f7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.583879 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d704-8f24-4cde-b3d8-57b70c3909f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.584322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072d704-8f24-4cde-b3d8-57b70c3909f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.591611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:12.595808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d704-8f24-4cde-b3d8-57b70c3909f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:12.597460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072d704-8f24-4cde-b3d8-57b70c3909f7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-2072d704-8f24-4cde-b3d8-57b70c3909f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:12.613210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:12.615080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:12.616011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:12.616011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:12.616011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:12.617216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 460/910] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:12.625559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeab16-c409-48d2-9f11-e7271970beb2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:12.634157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072d704-8f24-4cde-b3d8-57b70c3909f7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:12.735188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeab16-c409-48d2-9f11-e7271970beb2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:12.740604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072d704-8f24-4cde-b3d8-57b70c3909f7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:12.772264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ea87-fb27-4beb-a7f9-0feb8d55d248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:12.773032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ea87-fb27-4beb-a7f9-0feb8d55d248 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.773424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ea87-fb27-4beb-a7f9-0feb8d55d248 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.773839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ea87-fb27-4beb-a7f9-0feb8d55d248 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.774717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6ea87-fb27-4beb-a7f9-0feb8d55d248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:12.775093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6ea87-fb27-4beb-a7f9-0feb8d55d248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:12.776948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6ea87-fb27-4beb-a7f9-0feb8d55d248 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:12.777702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d91a-2169-4f8a-94d8-37ef87f3511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:12.778614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d91a-2169-4f8a-94d8-37ef87f3511a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.779064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d91a-2169-4f8a-94d8-37ef87f3511a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.779609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868d91a-2169-4f8a-94d8-37ef87f3511a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.780363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868d91a-2169-4f8a-94d8-37ef87f3511a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:12.781911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868d91a-2169-4f8a-94d8-37ef87f3511a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:12.790290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 451/911] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-b868d91a-2169-4f8a-94d8-37ef87f3511a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:12.792376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:12.793348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 19:41:12.794240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:12.796083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 461/912] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:41:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:12.796894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ea87-fb27-4beb-a7f9-0feb8d55d248 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:12.807271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d91a-2169-4f8a-94d8-37ef87f3511a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:12.813579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:12.880392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:12.913580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ea87-fb27-4beb-a7f9-0feb8d55d248 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:12.944250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868d91a-2169-4f8a-94d8-37ef87f3511a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:12.953469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb2ee2-47ee-4ab5-8f11-7c3724c78fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:12.954277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb2ee2-47ee-4ab5-8f11-7c3724c78fa2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.954524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb2ee2-47ee-4ab5-8f11-7c3724c78fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.954845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb2ee2-47ee-4ab5-8f11-7c3724c78fa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.962418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb2ee2-47ee-4ab5-8f11-7c3724c78fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:12.964167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb2ee2-47ee-4ab5-8f11-7c3724c78fa2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-75fb2ee2-47ee-4ab5-8f11-7c3724c78fa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:12.977140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:12.978062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:12.978967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:12.978967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:12.978967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:12.978967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:12.978967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:12.978967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:12.978967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:12.978967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:12.983404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 452/913] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:12.984237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb2ee2-47ee-4ab5-8f11-7c3724c78fa2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:12.988659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126903f-802c-4340-9004-9ccb9852df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:12.990436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126903f-802c-4340-9004-9ccb9852df80 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:12.990901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126903f-802c-4340-9004-9ccb9852df80 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:12.991376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126903f-802c-4340-9004-9ccb9852df80 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:12.992212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126903f-802c-4340-9004-9ccb9852df80 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:12.992708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126903f-802c-4340-9004-9ccb9852df80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:12.994270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126903f-802c-4340-9004-9ccb9852df80 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:13.007097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 462/914] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:41:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:13.008155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126903f-802c-4340-9004-9ccb9852df80 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:13.089019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:13.122097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb2ee2-47ee-4ab5-8f11-7c3724c78fa2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:13.140272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126903f-802c-4340-9004-9ccb9852df80 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:13.159631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0a0be-eb74-4811-8868-8e2e779502b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:13.160247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0a0be-eb74-4811-8868-8e2e779502b6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:13.160528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0a0be-eb74-4811-8868-8e2e779502b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:13.160802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0a0be-eb74-4811-8868-8e2e779502b6 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:13.161571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0a0be-eb74-4811-8868-8e2e779502b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:13.161882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0a0be-eb74-4811-8868-8e2e779502b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:13.162140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:13.163573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0a0be-eb74-4811-8868-8e2e779502b6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:13.179717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db70a-66cf-4282-8452-b8431400d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:13.180715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db70a-66cf-4282-8452-b8431400d266 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:13.181173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db70a-66cf-4282-8452-b8431400d266 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:13.181625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db70a-66cf-4282-8452-b8431400d266 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:13.182534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91db70a-66cf-4282-8452-b8431400d266 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:13.183051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 453/915] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:13.183307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91db70a-66cf-4282-8452-b8431400d266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:13.184128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0a0be-eb74-4811-8868-8e2e779502b6 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:13.185077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91db70a-66cf-4282-8452-b8431400d266 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:13.192964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 463/916] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Aug 22 19:41:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:13.198371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db70a-66cf-4282-8452-b8431400d266 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:13.312035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0a0be-eb74-4811-8868-8e2e779502b6 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:13.329965 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db70a-66cf-4282-8452-b8431400d266 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:13.354074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:13.363256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c78e9-c670-4a63-b518-2c26d4dfae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:13.363888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c78e9-c670-4a63-b518-2c26d4dfae38 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:13.365102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c78e9-c670-4a63-b518-2c26d4dfae38 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:13.365389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c78e9-c670-4a63-b518-2c26d4dfae38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:13.366126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c78e9-c670-4a63-b518-2c26d4dfae38 None admin] RBAC: Adding query filter params (role.id=257229bcf1764aeab851927e4344336c, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=2e09e41723f5430aad58bbca945d1447) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:13.366437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c78e9-c670-4a63-b518-2c26d4dfae38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:13.367939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c78e9-c670-4a63-b518-2c26d4dfae38 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:13.373038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6227f8f-0ea3-41d4-ba37-5911f2408050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:13.374256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 454/917] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:13 2022] GET /identity/v3/role_assignments?user.id=2e09e41723f5430aad58bbca945d1447&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=257229bcf1764aeab851927e4344336c => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:13.379470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227f8f-0ea3-41d4-ba37-5911f2408050 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:13.383343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227f8f-0ea3-41d4-ba37-5911f2408050 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:13.383343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6227f8f-0ea3-41d4-ba37-5911f2408050 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:13.383343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6227f8f-0ea3-41d4-ba37-5911f2408050 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:13.383343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6227f8f-0ea3-41d4-ba37-5911f2408050 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:13.463775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 464/918] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:41:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:41:14.048378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9061-66a5-488f-9292-90a59aa11283 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:14.049483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9061-66a5-488f-9292-90a59aa11283 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:14.049999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9061-66a5-488f-9292-90a59aa11283 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:14.051870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 455/919] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:14.056926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d39ef-53d1-4342-bdc9-835e899f1c9b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:14.057210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d39ef-53d1-4342-bdc9-835e899f1c9b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:14.057484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d39ef-53d1-4342-bdc9-835e899f1c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:14.076293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ba7d39ef-53d1-4342-bdc9-835e899f1c9b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:14.077479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ba7d39ef-53d1-4342-bdc9-835e899f1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:14.109891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:14.159894 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 465/920] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:14.305648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cfcab-abf5-433c-bbeb-7e6a11312f86 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:14.305863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cfcab-abf5-433c-bbeb-7e6a11312f86 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:14.306108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cfcab-abf5-433c-bbeb-7e6a11312f86 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:14.307771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 456/921] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:14.312895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f17c5f-dbcf-43a0-a95b-4a995bfa25e7 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:14.313190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f17c5f-dbcf-43a0-a95b-4a995bfa25e7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:14.314013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f17c5f-dbcf-43a0-a95b-4a995bfa25e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:14.334321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-14f17c5f-dbcf-43a0-a95b-4a995bfa25e7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:14.335575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-14f17c5f-dbcf-43a0-a95b-4a995bfa25e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:14.421978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 466/922] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:14.433538 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cfcab-abf5-433c-bbeb-7e6a11312f86 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:14.550543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cfcab-abf5-433c-bbeb-7e6a11312f86 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:14.586686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48be532-c807-4887-a7fa-47a9088fa578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:14.587352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48be532-c807-4887-a7fa-47a9088fa578 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:14.587636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48be532-c807-4887-a7fa-47a9088fa578 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:14.587911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48be532-c807-4887-a7fa-47a9088fa578 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:14.588501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48be532-c807-4887-a7fa-47a9088fa578 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:14.589879 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48be532-c807-4887-a7fa-47a9088fa578 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-d48be532-c807-4887-a7fa-47a9088fa578 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:14.598853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:14.600063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:14.600974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 457/923] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:14.605918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f17c5f-dbcf-43a0-a95b-4a995bfa25e7 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:14.703238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:14.709560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48be532-c807-4887-a7fa-47a9088fa578 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:14.710191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f17c5f-dbcf-43a0-a95b-4a995bfa25e7 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:14.748804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589f43-afcf-40f2-bf2e-1eff0c187a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:14.749425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589f43-afcf-40f2-bf2e-1eff0c187a0e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:14.749701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589f43-afcf-40f2-bf2e-1eff0c187a0e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:14.749973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f589f43-afcf-40f2-bf2e-1eff0c187a0e None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:14.750611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f589f43-afcf-40f2-bf2e-1eff0c187a0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:14.751615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f589f43-afcf-40f2-bf2e-1eff0c187a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:14.753057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f589f43-afcf-40f2-bf2e-1eff0c187a0e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:14.758570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 467/924] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:14.764153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589f43-afcf-40f2-bf2e-1eff0c187a0e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:14.780654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:14.829647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48be532-c807-4887-a7fa-47a9088fa578 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:14.867151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48c2c5-7814-4f9a-a0d7-3f31d24a11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:14.868068 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48c2c5-7814-4f9a-a0d7-3f31d24a11d3 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:14.868628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48c2c5-7814-4f9a-a0d7-3f31d24a11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:14.868906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48c2c5-7814-4f9a-a0d7-3f31d24a11d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:14.869503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48c2c5-7814-4f9a-a0d7-3f31d24a11d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:14.871403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48c2c5-7814-4f9a-a0d7-3f31d24a11d3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:14.873774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f589f43-afcf-40f2-bf2e-1eff0c187a0e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-9c48c2c5-7814-4f9a-a0d7-3f31d24a11d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:14.882294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:14.884074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:14.885206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 458/925] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Aug 22 19:41:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:14.891478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48c2c5-7814-4f9a-a0d7-3f31d24a11d3 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:14.922081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095e24c-ac83-452d-a722-8c4ac22408b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:14.922707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e24c-ac83-452d-a722-8c4ac22408b7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:14.923047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e24c-ac83-452d-a722-8c4ac22408b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:14.923539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095e24c-ac83-452d-a722-8c4ac22408b7 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:14.924369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095e24c-ac83-452d-a722-8c4ac22408b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:14.924675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095e24c-ac83-452d-a722-8c4ac22408b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:14.926291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095e24c-ac83-452d-a722-8c4ac22408b7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:14.932407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 468/926] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:14.939508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095e24c-ac83-452d-a722-8c4ac22408b7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:14.966558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:15.038587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48c2c5-7814-4f9a-a0d7-3f31d24a11d3 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:15.053843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095e24c-ac83-452d-a722-8c4ac22408b7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:15.073286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:15.088831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50e026-555d-4f19-8810-94ab8e5e7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:15.089577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e026-555d-4f19-8810-94ab8e5e7b90 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.090046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e026-555d-4f19-8810-94ab8e5e7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.090317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e026-555d-4f19-8810-94ab8e5e7b90 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:15.091248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50e026-555d-4f19-8810-94ab8e5e7b90 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:15.091558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50e026-555d-4f19-8810-94ab8e5e7b90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:15.093610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50e026-555d-4f19-8810-94ab8e5e7b90 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:15.097946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c8fb8-554b-4c32-91e8-e40d75603ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:15.098707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c8fb8-554b-4c32-91e8-e40d75603ee8 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.099092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c8fb8-554b-4c32-91e8-e40d75603ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.099494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c8fb8-554b-4c32-91e8-e40d75603ee8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:15.100305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 459/927] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:15.100423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c8fb8-554b-4c32-91e8-e40d75603ee8 None admin] RBAC: Adding query filter params (interface=public, service_id=2b914c8727db452185164e2c7c356e7c, region_id=RegionOne) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:15.105162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c8fb8-554b-4c32-91e8-e40d75603ee8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:15.106037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50e026-555d-4f19-8810-94ab8e5e7b90 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:15.106594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c8fb8-554b-4c32-91e8-e40d75603ee8 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:15.115085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 469/928] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 19:41:14 2022] GET /identity/v3/endpoints?service_id=2b914c8727db452185164e2c7c356e7c&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:15.124771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c8fb8-554b-4c32-91e8-e40d75603ee8 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:15.226866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50e026-555d-4f19-8810-94ab8e5e7b90 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:15.242217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:15.263272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c8fb8-554b-4c32-91e8-e40d75603ee8 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:15.265596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba72b0-d2b5-495f-a9ee-1d0967969984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:15.266202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba72b0-d2b5-495f-a9ee-1d0967969984 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.266472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba72b0-d2b5-495f-a9ee-1d0967969984 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.267314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba72b0-d2b5-495f-a9ee-1d0967969984 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:15.267949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba72b0-d2b5-495f-a9ee-1d0967969984 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:15.268324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba72b0-d2b5-495f-a9ee-1d0967969984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:15.269785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba72b0-d2b5-495f-a9ee-1d0967969984 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:15.281779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 460/929] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:15.283282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba72b0-d2b5-495f-a9ee-1d0967969984 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:15.307141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f9cc8-a773-4870-991d-aab1f2e33779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:15.307787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f9cc8-a773-4870-991d-aab1f2e33779 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.308112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f9cc8-a773-4870-991d-aab1f2e33779 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.309114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f9cc8-a773-4870-991d-aab1f2e33779 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:15.309741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f9cc8-a773-4870-991d-aab1f2e33779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:15.311642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f9cc8-a773-4870-991d-aab1f2e33779 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:15.319411 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 470/930] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 19:41:15 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:41:15.353228 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:15.421223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba72b0-d2b5-495f-a9ee-1d0967969984 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:15.429545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c170a5-24c4-4d49-a510-eb68b0b9b47c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.429857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c170a5-24c4-4d49-a510-eb68b0b9b47c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.430072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c170a5-24c4-4d49-a510-eb68b0b9b47c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:15.431741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 471/931] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:15.441070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84b2f-a9c7-4fdd-ac46-112b002b961c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.441533 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84b2f-a9c7-4fdd-ac46-112b002b961c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.441912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84b2f-a9c7-4fdd-ac46-112b002b961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:15.462736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-daf84b2f-a9c7-4fdd-ac46-112b002b961c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:15.464303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-daf84b2f-a9c7-4fdd-ac46-112b002b961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:15.467120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3d933-14a7-46e0-a88e-25eaed8e8702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:15.467781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3d933-14a7-46e0-a88e-25eaed8e8702 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.468058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3d933-14a7-46e0-a88e-25eaed8e8702 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.468329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3d933-14a7-46e0-a88e-25eaed8e8702 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:15.468996 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3d933-14a7-46e0-a88e-25eaed8e8702 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:15.471014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3d933-14a7-46e0-a88e-25eaed8e8702 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:15.541737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 472/932] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:15.543081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642a75d-5431-4934-9e1e-c788c9af1e7c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.543399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642a75d-5431-4934-9e1e-c788c9af1e7c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.543709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642a75d-5431-4934-9e1e-c788c9af1e7c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:15.544928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 473/933] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:15.550893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237feaed-859a-4990-a1d1-03eb007edab8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.551172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237feaed-859a-4990-a1d1-03eb007edab8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.551464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237feaed-859a-4990-a1d1-03eb007edab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:15.570771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-237feaed-859a-4990-a1d1-03eb007edab8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:15.572002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-237feaed-859a-4990-a1d1-03eb007edab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:15.589902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 461/934] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:41:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:15.669320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 474/935] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:15.823477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3d933-14a7-46e0-a88e-25eaed8e8702 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:15.938803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3d933-14a7-46e0-a88e-25eaed8e8702 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:15.950686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:15.950868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237feaed-859a-4990-a1d1-03eb007edab8 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:15.965526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:15.984241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b495289-f128-4e21-8da0-7866bb892331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:15.984919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495289-f128-4e21-8da0-7866bb892331 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:15.985195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495289-f128-4e21-8da0-7866bb892331 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:15.985659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495289-f128-4e21-8da0-7866bb892331 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:16.000925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b495289-f128-4e21-8da0-7866bb892331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-6b495289-f128-4e21-8da0-7866bb892331 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:16.007256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:16.008218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:16.009799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 462/936] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 19:41:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:16.014702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b495289-f128-4e21-8da0-7866bb892331 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:16.088241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237feaed-859a-4990-a1d1-03eb007edab8 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:16.135316 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b495289-f128-4e21-8da0-7866bb892331 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:16.136440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:16.137541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:16.138865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:16.139343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:16.140180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:16.142361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:16.145754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING keystone.server.flask.common [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 19:41:16.175480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca737dd8-4b97-4874-a30f-5986459fa27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:16.179040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca737dd8-4b97-4874-a30f-5986459fa27a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:16.179040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca737dd8-4b97-4874-a30f-5986459fa27a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:16.179040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca737dd8-4b97-4874-a30f-5986459fa27a None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:16.179040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca737dd8-4b97-4874-a30f-5986459fa27a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:16.179040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca737dd8-4b97-4874-a30f-5986459fa27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:16.179040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca737dd8-4b97-4874-a30f-5986459fa27a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:16.187711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 463/937] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 19:41:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:16.193529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca737dd8-4b97-4874-a30f-5986459fa27a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:16.203048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.sql.core [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 19:41:16.203048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 19:41:16.203048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [parameters: {'id': '9fb7b1261dd34c5396bfd3992b59c8dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 19:41:16.203048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93485) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9fb7b1261dd34c5396bfd3992b59c8dc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9fb7b1261dd34c5396bfd3992b59c8dc. Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application conn.query(q) Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 19:41:16.211479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application result.read() Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 19:41:16.212300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application next(self.gen) Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application yield resource Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application next(self.gen) Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise self.value Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application session.commit() Aug 22 19:41:16.213283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.session.flush() Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application compat.raise_( Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 19:41:16.214197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 19:41:16.220349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application conn.query(q) Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application result.read() Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 19:41:16.221164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [parameters: {'id': '9fb7b1261dd34c5396bfd3992b59c8dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:16.222050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:16.222819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9fb7b1261dd34c5396bfd3992b59c8dc. Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 475/938] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Aug 22 19:41:15 2022] POST /identity/v3/projects => generated 262 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:16.223765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:16.247620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:16.324875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca737dd8-4b97-4874-a30f-5986459fa27a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:16.339715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:16.364623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6625a50-0523-4976-940b-514e4341fd89 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:16.366957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6757e6d-9dc1-4f9e-96aa-f2dc3605cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:16.368671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6757e6d-9dc1-4f9e-96aa-f2dc3605cf46 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:16.369079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6757e6d-9dc1-4f9e-96aa-f2dc3605cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:16.369424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6757e6d-9dc1-4f9e-96aa-f2dc3605cf46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:16.383571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6757e6d-9dc1-4f9e-96aa-f2dc3605cf46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:16.385607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6757e6d-9dc1-4f9e-96aa-f2dc3605cf46 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-a6757e6d-9dc1-4f9e-96aa-f2dc3605cf46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:16.406552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:16.408100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:16.409003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:16.409003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:16.409003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:16.409003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 464/939] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:16.413160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6757e6d-9dc1-4f9e-96aa-f2dc3605cf46 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:16.416252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6145b26-973b-4e2c-b250-ec34057f4103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:16.417205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6145b26-973b-4e2c-b250-ec34057f4103 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:16.417738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6145b26-973b-4e2c-b250-ec34057f4103 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:16.418228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6145b26-973b-4e2c-b250-ec34057f4103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:16.426090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6145b26-973b-4e2c-b250-ec34057f4103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:16.428175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6145b26-973b-4e2c-b250-ec34057f4103 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-c6145b26-973b-4e2c-b250-ec34057f4103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:16.440396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:16.441297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:16.442204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:16.442204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:16.442204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:16.442204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:16.442204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:16.442204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:16.442204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:16.442204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:16.444612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 476/940] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:16.451053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6145b26-973b-4e2c-b250-ec34057f4103 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:16.529028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:16.553057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6757e6d-9dc1-4f9e-96aa-f2dc3605cf46 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:16.572723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6145b26-973b-4e2c-b250-ec34057f4103 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:16.600233 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5901b-b937-4613-bc50-c166eb8b2cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:16.601406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5901b-b937-4613-bc50-c166eb8b2cca None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:16.602104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5901b-b937-4613-bc50-c166eb8b2cca None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:16.603055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5901b-b937-4613-bc50-c166eb8b2cca None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:16.604208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5901b-b937-4613-bc50-c166eb8b2cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:16.604878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5901b-b937-4613-bc50-c166eb8b2cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:16.607258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5901b-b937-4613-bc50-c166eb8b2cca None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:16.610831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1c9c6-708b-4a20-8f6c-b0fafa6f6138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:16.611584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1c9c6-708b-4a20-8f6c-b0fafa6f6138 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:16.611868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1c9c6-708b-4a20-8f6c-b0fafa6f6138 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:16.612143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1c9c6-708b-4a20-8f6c-b0fafa6f6138 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:16.612813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1c9c6-708b-4a20-8f6c-b0fafa6f6138 None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:16.613116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1c9c6-708b-4a20-8f6c-b0fafa6f6138 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:16.614562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1c9c6-708b-4a20-8f6c-b0fafa6f6138 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:16.622820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 465/941] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:16.628134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:16.632336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5901b-b937-4613-bc50-c166eb8b2cca None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:16.639378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 477/942] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:41:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:16.766058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5901b-b937-4613-bc50-c166eb8b2cca None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:16.804599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2a221-5a24-4487-866d-eed19bdb068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:16.805232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2a221-5a24-4487-866d-eed19bdb068f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:16.805512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2a221-5a24-4487-866d-eed19bdb068f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:16.805784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2a221-5a24-4487-866d-eed19bdb068f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:16.814643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2a221-5a24-4487-866d-eed19bdb068f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:16.816133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2a221-5a24-4487-866d-eed19bdb068f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-38b2a221-5a24-4487-866d-eed19bdb068f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:16.827651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:16.828676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:16.831303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 466/943] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:41:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:16.836181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1c9c6-708b-4a20-8f6c-b0fafa6f6138 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:16.956054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1c9c6-708b-4a20-8f6c-b0fafa6f6138 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:16.992491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46da37-4bfc-4aeb-b5e3-e1d96122d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:16.993526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46da37-4bfc-4aeb-b5e3-e1d96122d110 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:16.994017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46da37-4bfc-4aeb-b5e3-e1d96122d110 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:16.994502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46da37-4bfc-4aeb-b5e3-e1d96122d110 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:16.995490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46da37-4bfc-4aeb-b5e3-e1d96122d110 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:16.996013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46da37-4bfc-4aeb-b5e3-e1d96122d110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:16.997649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46da37-4bfc-4aeb-b5e3-e1d96122d110 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:17.017518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 478/944] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 19:41:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:17.023285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2a221-5a24-4487-866d-eed19bdb068f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:17.027546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:17.133950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2a221-5a24-4487-866d-eed19bdb068f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:17.169837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bea344-127f-4b33-8325-d7560fb285c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:17.170460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bea344-127f-4b33-8325-d7560fb285c8 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:17.170764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bea344-127f-4b33-8325-d7560fb285c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:17.171034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bea344-127f-4b33-8325-d7560fb285c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:17.182138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bea344-127f-4b33-8325-d7560fb285c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:17.183663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bea344-127f-4b33-8325-d7560fb285c8 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-30bea344-127f-4b33-8325-d7560fb285c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:17.203375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:17.204516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:17.206097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:17.206097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:17.206097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:17.206097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 467/945] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:17.210833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46da37-4bfc-4aeb-b5e3-e1d96122d110 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:17.259421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:17.323266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46da37-4bfc-4aeb-b5e3-e1d96122d110 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:17.360951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858fcc7-f2a7-4351-9281-b7c1d34a8c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:17.361837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858fcc7-f2a7-4351-9281-b7c1d34a8c73 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:17.361837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858fcc7-f2a7-4351-9281-b7c1d34a8c73 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:17.362151 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858fcc7-f2a7-4351-9281-b7c1d34a8c73 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:17.362764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858fcc7-f2a7-4351-9281-b7c1d34a8c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:17.363060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858fcc7-f2a7-4351-9281-b7c1d34a8c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:17.364503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858fcc7-f2a7-4351-9281-b7c1d34a8c73 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:17.376643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 479/946] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:17.382561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bea344-127f-4b33-8325-d7560fb285c8 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:17.400953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b179c-d64b-4d4e-84f9-690e1f461f09 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:17.401237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b179c-d64b-4d4e-84f9-690e1f461f09 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:17.401510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b179c-d64b-4d4e-84f9-690e1f461f09 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:17.403155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 480/947] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:17.412219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a75567-1433-4927-bf14-d01b6d048413 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:17.412494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a75567-1433-4927-bf14-d01b6d048413 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:17.412768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a75567-1433-4927-bf14-d01b6d048413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:17.436716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-60a75567-1433-4927-bf14-d01b6d048413 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:17.438863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-60a75567-1433-4927-bf14-d01b6d048413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:17.455262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:17.532334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bea344-127f-4b33-8325-d7560fb285c8 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:17.555369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 481/948] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:17.579294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878a374-91bb-4a8b-8edd-2fc72ff72e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:17.580404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878a374-91bb-4a8b-8edd-2fc72ff72e65 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:17.580861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878a374-91bb-4a8b-8edd-2fc72ff72e65 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:17.581326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878a374-91bb-4a8b-8edd-2fc72ff72e65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:17.589193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878a374-91bb-4a8b-8edd-2fc72ff72e65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:17.590929 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878a374-91bb-4a8b-8edd-2fc72ff72e65 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-8878a374-91bb-4a8b-8edd-2fc72ff72e65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:17.602900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:17.603858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:17.604740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:17.604740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:17.604740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:17.604740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:17.604740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:17.604740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:17.604740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:17.604740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:17.606787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 468/949] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:17.613443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a75567-1433-4927-bf14-d01b6d048413 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:17.645808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:17.669318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938de6b4-a33a-438b-b134-0a72ede2ac55 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:17.669610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938de6b4-a33a-438b-b134-0a72ede2ac55 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:17.669876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938de6b4-a33a-438b-b134-0a72ede2ac55 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:17.671522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 469/950] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:17.677525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0fabd-1fbf-4350-9431-e11987295b9f None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:17.677811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0fabd-1fbf-4350-9431-e11987295b9f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:17.678089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0fabd-1fbf-4350-9431-e11987295b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:17.700154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6fb0fabd-1fbf-4350-9431-e11987295b9f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:17.701716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6fb0fabd-1fbf-4350-9431-e11987295b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:17.729974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a75567-1433-4927-bf14-d01b6d048413 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:17.766682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3825-cf57-4212-884e-a9fe791ece29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:17.767603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3825-cf57-4212-884e-a9fe791ece29 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:17.767940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3825-cf57-4212-884e-a9fe791ece29 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:17.768257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3825-cf57-4212-884e-a9fe791ece29 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:17.768971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af3825-cf57-4212-884e-a9fe791ece29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:17.769544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af3825-cf57-4212-884e-a9fe791ece29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:17.770815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af3825-cf57-4212-884e-a9fe791ece29 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:17.780933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 470/951] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:17.790049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 482/952] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:17.796145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0fabd-1fbf-4350-9431-e11987295b9f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:17.853168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3825-cf57-4212-884e-a9fe791ece29 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:17.853355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:17.916058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0fabd-1fbf-4350-9431-e11987295b9f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:17.959915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:17.968226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177005f-9e47-4f71-b85f-31e3621473a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:17.969145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177005f-9e47-4f71-b85f-31e3621473a0 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:17.969649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177005f-9e47-4f71-b85f-31e3621473a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:17.970145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3825-cf57-4212-884e-a9fe791ece29 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:17.970461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177005f-9e47-4f71-b85f-31e3621473a0 None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/2e09e41723f5430aad58bbca945d1447/roles/257229bcf1764aeab851927e4344336c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:17.973816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177005f-9e47-4f71-b85f-31e3621473a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=2e09e41723f5430aad58bbca945d1447, role_id=257229bcf1764aeab851927e4344336c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:17.975566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177005f-9e47-4f71-b85f-31e3621473a0 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:18.007467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080208b-68dd-4c1e-896c-b4c03b4c17b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:18.008105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080208b-68dd-4c1e-896c-b4c03b4c17b2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:18.008393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080208b-68dd-4c1e-896c-b4c03b4c17b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:18.008660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080208b-68dd-4c1e-896c-b4c03b4c17b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:18.009247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080208b-68dd-4c1e-896c-b4c03b4c17b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:18.010667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080208b-68dd-4c1e-896c-b4c03b4c17b2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-1080208b-68dd-4c1e-896c-b4c03b4c17b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:18.019553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:18.020690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:18.022044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 483/953] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:18.027350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080208b-68dd-4c1e-896c-b4c03b4c17b2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:18.069855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 471/954] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:41:17 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/2e09e41723f5430aad58bbca945d1447/roles/257229bcf1764aeab851927e4344336c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:41:18.070853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177005f-9e47-4f71-b85f-31e3621473a0 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:18.150656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080208b-68dd-4c1e-896c-b4c03b4c17b2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:18.192117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34e04e-96f2-4e0b-88a1-0e2a3e22e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:18.193024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177005f-9e47-4f71-b85f-31e3621473a0 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:18.193717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34e04e-96f2-4e0b-88a1-0e2a3e22e760 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:18.194186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34e04e-96f2-4e0b-88a1-0e2a3e22e760 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:18.194648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34e04e-96f2-4e0b-88a1-0e2a3e22e760 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:18.195739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34e04e-96f2-4e0b-88a1-0e2a3e22e760 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:18.196158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:18.196441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34e04e-96f2-4e0b-88a1-0e2a3e22e760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:18.199026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34e04e-96f2-4e0b-88a1-0e2a3e22e760 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:18.211841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 484/955] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:18.212671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34e04e-96f2-4e0b-88a1-0e2a3e22e760 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:18.241534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:18.254651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1460a-81dc-455a-b480-0277314edd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:18.255341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1460a-81dc-455a-b480-0277314edd95 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:18.255623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1460a-81dc-455a-b480-0277314edd95 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:18.255893 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1460a-81dc-455a-b480-0277314edd95 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:18.256491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1460a-81dc-455a-b480-0277314edd95 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:18.257894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1460a-81dc-455a-b480-0277314edd95 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-e1c1460a-81dc-455a-b480-0277314edd95 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:18.272140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:18.274235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:18.275146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 472/956] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:18.279775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1460a-81dc-455a-b480-0277314edd95 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:18.355153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34e04e-96f2-4e0b-88a1-0e2a3e22e760 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:18.389639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1460a-81dc-455a-b480-0277314edd95 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:18.398128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59d19a-f177-4307-8d17-6129d5ed6de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:18.398818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59d19a-f177-4307-8d17-6129d5ed6de6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:18.399166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59d19a-f177-4307-8d17-6129d5ed6de6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:18.399537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59d19a-f177-4307-8d17-6129d5ed6de6 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:18.400247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59d19a-f177-4307-8d17-6129d5ed6de6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:18.400621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59d19a-f177-4307-8d17-6129d5ed6de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:18.402145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59d19a-f177-4307-8d17-6129d5ed6de6 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:18.408490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 485/957] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:18.414511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59d19a-f177-4307-8d17-6129d5ed6de6 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:18.442439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529250bf-b2a4-44a6-9d89-c873e37bc588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:18.443382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529250bf-b2a4-44a6-9d89-c873e37bc588 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:18.443809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529250bf-b2a4-44a6-9d89-c873e37bc588 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:18.444243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529250bf-b2a4-44a6-9d89-c873e37bc588 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:18.445041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529250bf-b2a4-44a6-9d89-c873e37bc588 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:18.445506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529250bf-b2a4-44a6-9d89-c873e37bc588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:18.447095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529250bf-b2a4-44a6-9d89-c873e37bc588 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:18.453081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 473/958] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:41:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:18.467251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529250bf-b2a4-44a6-9d89-c873e37bc588 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:18.506057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:18.525417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:18.544415 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59d19a-f177-4307-8d17-6129d5ed6de6 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:18.581722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c5892-c302-4f7f-bd63-0d6ceeadd536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:18.583433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c5892-c302-4f7f-bd63-0d6ceeadd536 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:18.583726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c5892-c302-4f7f-bd63-0d6ceeadd536 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:18.584011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c5892-c302-4f7f-bd63-0d6ceeadd536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:18.584724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c5892-c302-4f7f-bd63-0d6ceeadd536 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:18.586023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c5892-c302-4f7f-bd63-0d6ceeadd536 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:18.588066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529250bf-b2a4-44a6-9d89-c873e37bc588 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:18.629355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd974f77-27fd-4177-9482-4710c873b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:18.630055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd974f77-27fd-4177-9482-4710c873b075 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:18.630400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd974f77-27fd-4177-9482-4710c873b075 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:18.630741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd974f77-27fd-4177-9482-4710c873b075 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:18.631475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd974f77-27fd-4177-9482-4710c873b075 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:18.631830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd974f77-27fd-4177-9482-4710c873b075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:18.639329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd974f77-27fd-4177-9482-4710c873b075 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:18.639329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 474/959] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:41:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:18.671401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 486/960] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:41:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:18.834688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca61d-fa9e-46b8-b6b6-112192da401d None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:18.835032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca61d-fa9e-46b8-b6b6-112192da401d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:18.835259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca61d-fa9e-46b8-b6b6-112192da401d None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:18.836720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 475/961] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:18.842735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe4273-9062-4b0d-b009-97a856933d7a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:18.843017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe4273-9062-4b0d-b009-97a856933d7a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:18.843319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe4273-9062-4b0d-b009-97a856933d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:18.865474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e4fe4273-9062-4b0d-b009-97a856933d7a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:18.867097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e4fe4273-9062-4b0d-b009-97a856933d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:18.949567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 487/962] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:19.240542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ca61d-fa9e-46b8-b6b6-112192da401d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:19.346058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:19.353568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ca61d-fa9e-46b8-b6b6-112192da401d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:19.389990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:19.390851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:19.391349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:19.391997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:19.392804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:19.394457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:19.399322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WARNING keystone.server.flask.common [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 19:41:19.478330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.sql.core [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 19:41:19.478330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 19:41:19.478330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [parameters: {'user_id': 'b5896d87bf214494bbfce758ecc52b13', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 19:41:19.478330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93486) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application conn.query(q) Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application result.read() Aug 22 19:41:19.496487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 19:41:19.497436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application next(self.gen) Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application yield resource Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application next(self.gen) Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise self.value Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application session.commit() Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 19:41:19.498980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self.session.flush() Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application compat.raise_( Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 19:41:19.499968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 19:41:19.500918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application conn.query(q) Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application result.read() Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 19:41:19.501778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b5896d87bf214494bbfce758ecc52b13', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:19.502618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 19:41:19.505358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 19:41:19.507503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 19:41:19.507503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 19:41:19.507503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 19:41:19.507503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 19:41:19.507503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 19:41:19.507503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:19.507503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 476/963] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Aug 22 19:41:19 2022] POST /identity/v3/users => generated 160 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:19.508418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe4273-9062-4b0d-b009-97a856933d7a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:19.574622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:19.616654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe4273-9062-4b0d-b009-97a856933d7a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:19.653874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48891230-eaee-4315-8ec1-3875a27c9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:19.654512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48891230-eaee-4315-8ec1-3875a27c9dcd None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:19.654792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48891230-eaee-4315-8ec1-3875a27c9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:19.655062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48891230-eaee-4315-8ec1-3875a27c9dcd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:19.663538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48891230-eaee-4315-8ec1-3875a27c9dcd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:19.665000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48891230-eaee-4315-8ec1-3875a27c9dcd None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-48891230-eaee-4315-8ec1-3875a27c9dcd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:19.677292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:19.678273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:19.679346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 488/964] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:41:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:19.686641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:19.808200 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38442ad4-d54c-485e-90aa-03a7a7a4b22e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:19.845767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b5f9-e1e0-4a9f-b0db-80afa0fa162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:19.846522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b5f9-e1e0-4a9f-b0db-80afa0fa162f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:19.846804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b5f9-e1e0-4a9f-b0db-80afa0fa162f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:19.847074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b5f9-e1e0-4a9f-b0db-80afa0fa162f None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:19.847824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b5f9-e1e0-4a9f-b0db-80afa0fa162f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:19.848126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b5f9-e1e0-4a9f-b0db-80afa0fa162f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:19.849776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b5f9-e1e0-4a9f-b0db-80afa0fa162f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:19.893747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 477/965] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Aug 22 19:41:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:20.092797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ac50-d48d-4450-9957-fe4495f2a9a3 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:20.093095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ac50-d48d-4450-9957-fe4495f2a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:20.093264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ac50-d48d-4450-9957-fe4495f2a9a3 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:20.095534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 489/966] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:20.101159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91785b33-ef5c-4bf2-9cfa-20c3393a8854 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:20.101444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91785b33-ef5c-4bf2-9cfa-20c3393a8854 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:20.101720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91785b33-ef5c-4bf2-9cfa-20c3393a8854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:20.121680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-91785b33-ef5c-4bf2-9cfa-20c3393a8854 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:20.123208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-91785b33-ef5c-4bf2-9cfa-20c3393a8854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:20.136236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:20.196225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 478/967] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:20.467992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ac50-d48d-4450-9957-fe4495f2a9a3 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:20.573780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ac50-d48d-4450-9957-fe4495f2a9a3 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:20.596999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:20.608367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd83a4-2010-4179-a22e-9a637d30d73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:20.612827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd83a4-2010-4179-a22e-9a637d30d73b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:20.612827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd83a4-2010-4179-a22e-9a637d30d73b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:20.612827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd83a4-2010-4179-a22e-9a637d30d73b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:20.621805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd83a4-2010-4179-a22e-9a637d30d73b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:20.622118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd7d9f-52ff-419a-bc68-da701762e9ff None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:20.622561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd7d9f-52ff-419a-bc68-da701762e9ff None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:20.622644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd7d9f-52ff-419a-bc68-da701762e9ff None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:20.624187 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 479/968] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-17bd83a4-2010-4179-a22e-9a637d30d73b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:20.627165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:20.628759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:20.629878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:20.630547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbdcf3-2875-451f-bac1-2c2dac7741e2 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:20.630547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbdcf3-2875-451f-bac1-2c2dac7741e2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:20.630547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbdcf3-2875-451f-bac1-2c2dac7741e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:20.633328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 490/969] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 19:41:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:20.634271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd83a4-2010-4179-a22e-9a637d30d73b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:20.650731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-bffbdcf3-2875-451f-bac1-2c2dac7741e2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:20.651870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bffbdcf3-2875-451f-bac1-2c2dac7741e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:20.730656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 480/970] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:20.736421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fad2c0-594d-46ef-aec4-47875a5afa1a None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:20.736707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fad2c0-594d-46ef-aec4-47875a5afa1a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:20.736984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fad2c0-594d-46ef-aec4-47875a5afa1a None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:20.738321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 481/971] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:20.743394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b3725-6680-44ac-b412-fd6b536e7760 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:20.743684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b3725-6680-44ac-b412-fd6b536e7760 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:20.743962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b3725-6680-44ac-b412-fd6b536e7760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:20.744404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd83a4-2010-4179-a22e-9a637d30d73b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:20.762168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fc4b3725-6680-44ac-b412-fd6b536e7760 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:20.763379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fc4b3725-6680-44ac-b412-fd6b536e7760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:20.780150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163da3d-14a0-42bb-8662-2a38764bec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:20.780752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163da3d-14a0-42bb-8662-2a38764bec1e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:20.781027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163da3d-14a0-42bb-8662-2a38764bec1e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:20.781294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163da3d-14a0-42bb-8662-2a38764bec1e None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:20.782498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163da3d-14a0-42bb-8662-2a38764bec1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:20.782800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163da3d-14a0-42bb-8662-2a38764bec1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:20.784195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163da3d-14a0-42bb-8662-2a38764bec1e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:20.792727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 491/972] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 19:41:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:20.798540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163da3d-14a0-42bb-8662-2a38764bec1e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:20.833409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 482/973] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:20.849640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:20.904745 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163da3d-14a0-42bb-8662-2a38764bec1e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:20.939867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffccad-79aa-4a82-85c2-d82bd0ce0355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:20.940820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffccad-79aa-4a82-85c2-d82bd0ce0355 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:20.941303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffccad-79aa-4a82-85c2-d82bd0ce0355 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:20.941794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffccad-79aa-4a82-85c2-d82bd0ce0355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:20.952465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffccad-79aa-4a82-85c2-d82bd0ce0355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:20.954233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffccad-79aa-4a82-85c2-d82bd0ce0355 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-4fffccad-79aa-4a82-85c2-d82bd0ce0355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:20.968482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:20.970043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:20.970934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:20.970934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:20.970934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:20.970934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 492/974] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:20.976676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b3725-6680-44ac-b412-fd6b536e7760 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:20.986579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:20.990122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffccad-79aa-4a82-85c2-d82bd0ce0355 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.086981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b3725-6680-44ac-b412-fd6b536e7760 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.092755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:21.098011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffccad-79aa-4a82-85c2-d82bd0ce0355 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.123631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8b5cd-6fbf-4e46-a135-a6569c35962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.124245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8b5cd-6fbf-4e46-a135-a6569c35962a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.124519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8b5cd-6fbf-4e46-a135-a6569c35962a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.124789 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8b5cd-6fbf-4e46-a135-a6569c35962a None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.125436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8b5cd-6fbf-4e46-a135-a6569c35962a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:21.125766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8b5cd-6fbf-4e46-a135-a6569c35962a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.127143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8b5cd-6fbf-4e46-a135-a6569c35962a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.135984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e4f7b-3079-470a-8408-333088944ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.136618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e4f7b-3079-470a-8408-333088944ba2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.136894 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e4f7b-3079-470a-8408-333088944ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.137164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e4f7b-3079-470a-8408-333088944ba2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.137748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e4f7b-3079-470a-8408-333088944ba2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.138961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 483/975] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:21.139086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e4f7b-3079-470a-8408-333088944ba2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.139849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8b5cd-6fbf-4e46-a135-a6569c35962a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-3b3e4f7b-3079-470a-8408-333088944ba2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:21.151268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:21.152477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:21.153368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 493/976] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:21.154261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e4f7b-3079-470a-8408-333088944ba2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.209310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:21.244444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8b5cd-6fbf-4e46-a135-a6569c35962a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.254141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e4f7b-3079-470a-8408-333088944ba2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.279543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4da40-6162-46cd-9eb2-3d99a5cfa9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.280154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4da40-6162-46cd-9eb2-3d99a5cfa9ab None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.280433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4da40-6162-46cd-9eb2-3d99a5cfa9ab None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.280706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4da40-6162-46cd-9eb2-3d99a5cfa9ab None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.281347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4da40-6162-46cd-9eb2-3d99a5cfa9ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.283092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4da40-6162-46cd-9eb2-3d99a5cfa9ab None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.288948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929fbdc-53e7-4a48-b9f0-7e5831b05c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.289570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929fbdc-53e7-4a48-b9f0-7e5831b05c2c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.289844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929fbdc-53e7-4a48-b9f0-7e5831b05c2c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.290192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929fbdc-53e7-4a48-b9f0-7e5831b05c2c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.300249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929fbdc-53e7-4a48-b9f0-7e5831b05c2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.301673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929fbdc-53e7-4a48-b9f0-7e5831b05c2c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-b929fbdc-53e7-4a48-b9f0-7e5831b05c2c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:21.312681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:21.314835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 494/977] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:41:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:21.316075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929fbdc-53e7-4a48-b9f0-7e5831b05c2c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.339938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:21.376582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 484/978] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:41:21 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:21.377436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4da40-6162-46cd-9eb2-3d99a5cfa9ab None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.430596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929fbdc-53e7-4a48-b9f0-7e5831b05c2c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.479103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aaff4-d651-4dde-883d-78bdaf756781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.479768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aaff4-d651-4dde-883d-78bdaf756781 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.480111 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aaff4-d651-4dde-883d-78bdaf756781 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.480447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aaff4-d651-4dde-883d-78bdaf756781 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.481561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aaff4-d651-4dde-883d-78bdaf756781 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:21.481933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aaff4-d651-4dde-883d-78bdaf756781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.483771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aaff4-d651-4dde-883d-78bdaf756781 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.489607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 495/979] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:21.495605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aaff4-d651-4dde-883d-78bdaf756781 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.510073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4da40-6162-46cd-9eb2-3d99a5cfa9ab None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.549961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:21.560390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c02eb4-887d-4519-980d-00f891874966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.561263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c02eb4-887d-4519-980d-00f891874966 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.561263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c02eb4-887d-4519-980d-00f891874966 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.561537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c02eb4-887d-4519-980d-00f891874966 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.562240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c02eb4-887d-4519-980d-00f891874966 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:21.562669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c02eb4-887d-4519-980d-00f891874966 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.564925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c02eb4-887d-4519-980d-00f891874966 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.584363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 485/980] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Aug 22 19:41:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:21.590296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c02eb4-887d-4519-980d-00f891874966 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.590444 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:21.611721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aaff4-d651-4dde-883d-78bdaf756781 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.654003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355da0da-22d2-4c3d-b9b9-9839c34c4557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.654982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355da0da-22d2-4c3d-b9b9-9839c34c4557 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.655532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355da0da-22d2-4c3d-b9b9-9839c34c4557 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.655865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355da0da-22d2-4c3d-b9b9-9839c34c4557 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.656504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355da0da-22d2-4c3d-b9b9-9839c34c4557 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:21.656802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355da0da-22d2-4c3d-b9b9-9839c34c4557 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.658205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355da0da-22d2-4c3d-b9b9-9839c34c4557 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.664075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 496/981] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:21.669124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355da0da-22d2-4c3d-b9b9-9839c34c4557 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.698956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c02eb4-887d-4519-980d-00f891874966 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.735809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb35d5-9890-40cf-a0df-25f11ee86104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.736334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb35d5-9890-40cf-a0df-25f11ee86104 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.736612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb35d5-9890-40cf-a0df-25f11ee86104 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.736880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb35d5-9890-40cf-a0df-25f11ee86104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.779290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355da0da-22d2-4c3d-b9b9-9839c34c4557 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.796928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:21.813742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb35d5-9890-40cf-a0df-25f11ee86104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.815440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb35d5-9890-40cf-a0df-25f11ee86104 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.816227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede688e-5e22-45fe-8e3a-009e0f565dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.817030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede688e-5e22-45fe-8e3a-009e0f565dbd None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.817468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede688e-5e22-45fe-8e3a-009e0f565dbd None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.817885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede688e-5e22-45fe-8e3a-009e0f565dbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.818756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede688e-5e22-45fe-8e3a-009e0f565dbd None admin] RBAC: Adding query filter params (interface=admin, service_id=2b914c8727db452185164e2c7c356e7c, region_id=RegionOne) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:21.819066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede688e-5e22-45fe-8e3a-009e0f565dbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.820480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede688e-5e22-45fe-8e3a-009e0f565dbd None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.831259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 497/982] 10.222.0.18 () {56 vars in 1249 bytes} [Mon Aug 22 19:41:21 2022] GET /identity/v3/endpoints?service_id=2b914c8727db452185164e2c7c356e7c&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:21.833489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede688e-5e22-45fe-8e3a-009e0f565dbd None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.846452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:21.932495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 486/983] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:21 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 19:41:21.939450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb35d5-9890-40cf-a0df-25f11ee86104 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:21.945873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede688e-5e22-45fe-8e3a-009e0f565dbd None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:21.981009 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87dd9-26e1-4b55-aa94-299fdb2be8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:21.981618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87dd9-26e1-4b55-aa94-299fdb2be8e2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:21.981891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87dd9-26e1-4b55-aa94-299fdb2be8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:21.982157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87dd9-26e1-4b55-aa94-299fdb2be8e2 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:21.982762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc87dd9-26e1-4b55-aa94-299fdb2be8e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:21.984144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc87dd9-26e1-4b55-aa94-299fdb2be8e2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:21.991542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 498/984] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 19:41:21 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:41:22.042895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:22.062023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb35d5-9890-40cf-a0df-25f11ee86104 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:22.102331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de81e9-68ae-4390-bd1f-e4fbefb1516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:22.103010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de81e9-68ae-4390-bd1f-e4fbefb1516a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:22.103363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de81e9-68ae-4390-bd1f-e4fbefb1516a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:22.103642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de81e9-68ae-4390-bd1f-e4fbefb1516a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:22.116014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de81e9-68ae-4390-bd1f-e4fbefb1516a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:22.117885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de81e9-68ae-4390-bd1f-e4fbefb1516a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-06de81e9-68ae-4390-bd1f-e4fbefb1516a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:22.137138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:22.138968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:22.140294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:22.140294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:22.140294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:22.140294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 487/985] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:22.148095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87dd9-26e1-4b55-aa94-299fdb2be8e2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:22.244345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:22.269377 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87dd9-26e1-4b55-aa94-299fdb2be8e2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:22.306467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c810d07-bb1c-46a3-a517-aaabf52b69f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:22.307077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c810d07-bb1c-46a3-a517-aaabf52b69f3 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:22.307392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c810d07-bb1c-46a3-a517-aaabf52b69f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:22.307661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c810d07-bb1c-46a3-a517-aaabf52b69f3 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:22.308300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c810d07-bb1c-46a3-a517-aaabf52b69f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:22.308597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c810d07-bb1c-46a3-a517-aaabf52b69f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:22.309964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c810d07-bb1c-46a3-a517-aaabf52b69f3 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:22.321696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 499/986] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:22.327167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de81e9-68ae-4390-bd1f-e4fbefb1516a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:22.444071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de81e9-68ae-4390-bd1f-e4fbefb1516a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:22.479793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f9014-4425-44cf-bbe9-d2649a8bc9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:22.480431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f9014-4425-44cf-bbe9-d2649a8bc9ad None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:22.480712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f9014-4425-44cf-bbe9-d2649a8bc9ad None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:22.480984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f9014-4425-44cf-bbe9-d2649a8bc9ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:22.483841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:22.489029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f9014-4425-44cf-bbe9-d2649a8bc9ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:22.490571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f9014-4425-44cf-bbe9-d2649a8bc9ad None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-b94f9014-4425-44cf-bbe9-d2649a8bc9ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:22.503178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:22.504571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:22.505678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:22.505678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:22.505678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:22.505678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:22.505678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:22.505678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:22.505678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:22.505678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:22.507532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 488/987] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:22.511740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c810d07-bb1c-46a3-a517-aaabf52b69f3 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:22.623176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c810d07-bb1c-46a3-a517-aaabf52b69f3 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:22.658900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ee2b5-aa56-48cc-ad11-482c2d5bd4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:22.659532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ee2b5-aa56-48cc-ad11-482c2d5bd4dc None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:22.659808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ee2b5-aa56-48cc-ad11-482c2d5bd4dc None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:22.660078 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ee2b5-aa56-48cc-ad11-482c2d5bd4dc None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:22.660767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ee2b5-aa56-48cc-ad11-482c2d5bd4dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:22.661069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ee2b5-aa56-48cc-ad11-482c2d5bd4dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:22.662500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ee2b5-aa56-48cc-ad11-482c2d5bd4dc None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:22.664101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:22.676970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 500/988] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:22.682969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f9014-4425-44cf-bbe9-d2649a8bc9ad None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:22.784583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f9014-4425-44cf-bbe9-d2649a8bc9ad None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:22.818881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3884d3-4df0-41cb-897f-2d6bcc75c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:22.819517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3884d3-4df0-41cb-897f-2d6bcc75c027 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:22.819793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3884d3-4df0-41cb-897f-2d6bcc75c027 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:22.820062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3884d3-4df0-41cb-897f-2d6bcc75c027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:22.820787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3884d3-4df0-41cb-897f-2d6bcc75c027 None admin] RBAC: Adding query filter params (role.id=257229bcf1764aeab851927e4344336c, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=2e09e41723f5430aad58bbca945d1447) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:22.821090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3884d3-4df0-41cb-897f-2d6bcc75c027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:22.822509 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3884d3-4df0-41cb-897f-2d6bcc75c027 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:22.835480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 489/989] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:22 2022] GET /identity/v3/role_assignments?user.id=2e09e41723f5430aad58bbca945d1447&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=257229bcf1764aeab851927e4344336c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:23.386254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f703e8-9fb4-43d2-a034-452ec1b6c86e None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:23.386664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f703e8-9fb4-43d2-a034-452ec1b6c86e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:23.386793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f703e8-9fb4-43d2-a034-452ec1b6c86e None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:23.388369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 501/990] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:23.395256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765ceee-cb41-4e3c-be9e-d21c0b74328e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:23.395256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765ceee-cb41-4e3c-be9e-d21c0b74328e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:23.395256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765ceee-cb41-4e3c-be9e-d21c0b74328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:23.418018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6765ceee-cb41-4e3c-be9e-d21c0b74328e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:23.419195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6765ceee-cb41-4e3c-be9e-d21c0b74328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:23.480227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:23.491772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 490/991] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:23.773742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f703e8-9fb4-43d2-a034-452ec1b6c86e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:23.881683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f703e8-9fb4-43d2-a034-452ec1b6c86e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:23.916845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80640c18-9269-45d5-911e-9c7e408b7fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:23.917501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640c18-9269-45d5-911e-9c7e408b7fcb None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:23.917793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640c18-9269-45d5-911e-9c7e408b7fcb None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:23.918044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640c18-9269-45d5-911e-9c7e408b7fcb None admin] PATH_INFO: `/v3/services/compute` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:23.918731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80640c18-9269-45d5-911e-9c7e408b7fcb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:23.920238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80640c18-9269-45d5-911e-9c7e408b7fcb None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-80640c18-9269-45d5-911e-9c7e408b7fcb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:23.931843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:23.932922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:23.936303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 502/992] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:23.938958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765ceee-cb41-4e3c-be9e-d21c0b74328e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:23.959772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ba3b1-2d14-41c9-91f8-691483b7a7b0 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:23.960056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ba3b1-2d14-41c9-91f8-691483b7a7b0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:23.960311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ba3b1-2d14-41c9-91f8-691483b7a7b0 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:23.961694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 503/993] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:23.966758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a048d-0de7-42bf-a43d-5653958b0018 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:23.967046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a048d-0de7-42bf-a43d-5653958b0018 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:23.967359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a048d-0de7-42bf-a43d-5653958b0018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:23.988647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f94a048d-0de7-42bf-a43d-5653958b0018 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:23.989850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f94a048d-0de7-42bf-a43d-5653958b0018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:24.045941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:24.047547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765ceee-cb41-4e3c-be9e-d21c0b74328e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:24.063712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 504/994] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:24.083131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ab735-49cb-478a-b793-86b3f9b27b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:24.083813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ab735-49cb-478a-b793-86b3f9b27b50 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.084148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ab735-49cb-478a-b793-86b3f9b27b50 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.084495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ab735-49cb-478a-b793-86b3f9b27b50 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.085095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ab735-49cb-478a-b793-86b3f9b27b50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:24.085442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ab735-49cb-478a-b793-86b3f9b27b50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:24.086912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ab735-49cb-478a-b793-86b3f9b27b50 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:24.092006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 491/995] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:41:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:24.097928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a048d-0de7-42bf-a43d-5653958b0018 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:24.199553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a048d-0de7-42bf-a43d-5653958b0018 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:24.233776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f81fc-c7f0-47d3-96ad-b8671a77eb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:24.234384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f81fc-c7f0-47d3-96ad-b8671a77eb25 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.234660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f81fc-c7f0-47d3-96ad-b8671a77eb25 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.235505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f81fc-c7f0-47d3-96ad-b8671a77eb25 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.236122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f81fc-c7f0-47d3-96ad-b8671a77eb25 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:24.236418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f81fc-c7f0-47d3-96ad-b8671a77eb25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:24.237788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f81fc-c7f0-47d3-96ad-b8671a77eb25 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:24.242761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 505/996] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:41:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:24.248578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ab735-49cb-478a-b793-86b3f9b27b50 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:24.305950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:24.334459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f81fc-c7f0-47d3-96ad-b8671a77eb25 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:24.354232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ab735-49cb-478a-b793-86b3f9b27b50 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:24.394435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243afea9-a66f-409e-844f-bdfae3a022ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:24.395048 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afea9-a66f-409e-844f-bdfae3a022ea None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.395355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afea9-a66f-409e-844f-bdfae3a022ea None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.395626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afea9-a66f-409e-844f-bdfae3a022ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.396335 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243afea9-a66f-409e-844f-bdfae3a022ea None admin] RBAC: Adding query filter params (interface=public, service_id=8c556d71bf404f929b96eb4e7a757622, region_id=RegionOne) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:24.396641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243afea9-a66f-409e-844f-bdfae3a022ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:24.397085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:24.398077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243afea9-a66f-409e-844f-bdfae3a022ea None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:24.406509 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 492/997] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 19:41:24 2022] GET /identity/v3/endpoints?service_id=8c556d71bf404f929b96eb4e7a757622&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:24.409441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243afea9-a66f-409e-844f-bdfae3a022ea None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:24.454788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f81fc-c7f0-47d3-96ad-b8671a77eb25 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:24.492460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91858a87-45b9-4a4a-94bd-e6f5500d5697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:24.493151 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91858a87-45b9-4a4a-94bd-e6f5500d5697 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.493429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91858a87-45b9-4a4a-94bd-e6f5500d5697 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.493697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91858a87-45b9-4a4a-94bd-e6f5500d5697 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.494302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91858a87-45b9-4a4a-94bd-e6f5500d5697 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:24.495702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91858a87-45b9-4a4a-94bd-e6f5500d5697 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-91858a87-45b9-4a4a-94bd-e6f5500d5697 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:24.505223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:24.506220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:24.507071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 506/998] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Aug 22 19:41:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:24.512137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91858a87-45b9-4a4a-94bd-e6f5500d5697 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:24.519944 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243afea9-a66f-409e-844f-bdfae3a022ea None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:24.538857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:24.556893 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5d438-4d5d-4cc9-966e-59aca35133c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:24.557447 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5d438-4d5d-4cc9-966e-59aca35133c7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.557701 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5d438-4d5d-4cc9-966e-59aca35133c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.557969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5d438-4d5d-4cc9-966e-59aca35133c7 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.558569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5d438-4d5d-4cc9-966e-59aca35133c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:24.559965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5d438-4d5d-4cc9-966e-59aca35133c7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:24.566694 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 493/999] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 19:41:24 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:41:24.621493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91858a87-45b9-4a4a-94bd-e6f5500d5697 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:24.642153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:24.662229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524fd1-771d-482b-9d7e-766527016598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:24.662856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524fd1-771d-482b-9d7e-766527016598 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.663133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524fd1-771d-482b-9d7e-766527016598 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.663431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524fd1-771d-482b-9d7e-766527016598 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.664087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524fd1-771d-482b-9d7e-766527016598 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:24.664389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524fd1-771d-482b-9d7e-766527016598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:24.665791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524fd1-771d-482b-9d7e-766527016598 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:24.675421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 507/1000] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:24.677073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5d438-4d5d-4cc9-966e-59aca35133c7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:24.764170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec216293-35c0-4dce-bd1c-ae187cec5116 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.764498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec216293-35c0-4dce-bd1c-ae187cec5116 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.764713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec216293-35c0-4dce-bd1c-ae187cec5116 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.766113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 508/1001] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:24.771731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9dbca-363a-44ed-bbb1-e943d957483a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.772013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9dbca-363a-44ed-bbb1-e943d957483a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.772350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9dbca-363a-44ed-bbb1-e943d957483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.790854 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c2f9dbca-363a-44ed-bbb1-e943d957483a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:24.792069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c2f9dbca-363a-44ed-bbb1-e943d957483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:24.795414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5d438-4d5d-4cc9-966e-59aca35133c7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:24.833986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48715a5-8841-4ab5-9d40-bde7876053c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:24.834505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48715a5-8841-4ab5-9d40-bde7876053c2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.834777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48715a5-8841-4ab5-9d40-bde7876053c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.835042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48715a5-8841-4ab5-9d40-bde7876053c2 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.835706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48715a5-8841-4ab5-9d40-bde7876053c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:24.836006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48715a5-8841-4ab5-9d40-bde7876053c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:24.837363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48715a5-8841-4ab5-9d40-bde7876053c2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:24.842662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 494/1002] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Aug 22 19:41:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:24.849854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48715a5-8841-4ab5-9d40-bde7876053c2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:24.874677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 509/1003] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:24.900851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:24.960567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48715a5-8841-4ab5-9d40-bde7876053c2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:24.997126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c2d4-aff5-4cd8-bb51-a17e8640f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:24.997968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c2d4-aff5-4cd8-bb51-a17e8640f486 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:24.998397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c2d4-aff5-4cd8-bb51-a17e8640f486 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:24.998842 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c2d4-aff5-4cd8-bb51-a17e8640f486 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:24.999693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53c2d4-aff5-4cd8-bb51-a17e8640f486 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:25.001890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53c2d4-aff5-4cd8-bb51-a17e8640f486 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:25.073473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 495/1004] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:41:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:41:25.143079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9dbca-363a-44ed-bbb1-e943d957483a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:25.259325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9dbca-363a-44ed-bbb1-e943d957483a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:25.270896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:25.301054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52466872-f0b9-45db-8f4b-4423b0d68219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:25.302295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52466872-f0b9-45db-8f4b-4423b0d68219 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:25.302571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52466872-f0b9-45db-8f4b-4423b0d68219 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:25.302836 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52466872-f0b9-45db-8f4b-4423b0d68219 None admin] PATH_INFO: `/v3/services/image` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:25.303436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52466872-f0b9-45db-8f4b-4423b0d68219 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:25.304800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52466872-f0b9-45db-8f4b-4423b0d68219 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-52466872-f0b9-45db-8f4b-4423b0d68219 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:25.313798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:25.314826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:25.316056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 510/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Aug 22 19:41:25 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:25.321123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c2d4-aff5-4cd8-bb51-a17e8640f486 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:25.437644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53c2d4-aff5-4cd8-bb51-a17e8640f486 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:25.445529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:25.473795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6b589-adee-4471-a3ae-40bb5b1d5c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:25.474855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b589-adee-4471-a3ae-40bb5b1d5c1a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:25.475528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b589-adee-4471-a3ae-40bb5b1d5c1a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:25.476354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6b589-adee-4471-a3ae-40bb5b1d5c1a None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:25.476984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b589-adee-4471-a3ae-40bb5b1d5c1a None admin] RBAC: Adding query filter params (name=image) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:25.477519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b589-adee-4471-a3ae-40bb5b1d5c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:25.478917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6b589-adee-4471-a3ae-40bb5b1d5c1a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:25.483800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 496/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:25.489823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52466872-f0b9-45db-8f4b-4423b0d68219 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:25.595478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52466872-f0b9-45db-8f4b-4423b0d68219 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:25.632772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679f48e-b558-4664-a1c5-70da0438b0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:25.633379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679f48e-b558-4664-a1c5-70da0438b0bc None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:25.633652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679f48e-b558-4664-a1c5-70da0438b0bc None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:25.633918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679f48e-b558-4664-a1c5-70da0438b0bc None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:25.634545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679f48e-b558-4664-a1c5-70da0438b0bc None admin] RBAC: Adding query filter params (type=image) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:25.634841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679f48e-b558-4664-a1c5-70da0438b0bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:25.636231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679f48e-b558-4664-a1c5-70da0438b0bc None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:25.640844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 511/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:26.511170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e373b-411c-41e7-aa8b-815a5877a061 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:26.511746 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e373b-411c-41e7-aa8b-815a5877a061 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:26.511746 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e373b-411c-41e7-aa8b-815a5877a061 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:26.513226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 497/1008] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:26.518457 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f9191-b0d6-4786-8f68-37341a79545c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:26.518935 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f9191-b0d6-4786-8f68-37341a79545c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:26.519015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f9191-b0d6-4786-8f68-37341a79545c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:26.536947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c52f9191-b0d6-4786-8f68-37341a79545c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:26.538138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c52f9191-b0d6-4786-8f68-37341a79545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:26.567587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:26.608902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 512/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:26.875301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e373b-411c-41e7-aa8b-815a5877a061 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:26.981289 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e373b-411c-41e7-aa8b-815a5877a061 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:27.017385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3b805-c513-431d-9e1b-e30a0c602157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:27.018012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3b805-c513-431d-9e1b-e30a0c602157 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.018271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3b805-c513-431d-9e1b-e30a0c602157 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.018541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3b805-c513-431d-9e1b-e30a0c602157 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.019125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3b805-c513-431d-9e1b-e30a0c602157 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:27.020611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3b805-c513-431d-9e1b-e30a0c602157 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-0ad3b805-c513-431d-9e1b-e30a0c602157 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:27.029378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:27.030495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:27.031401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 498/1010] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:27.034005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a86db-d14e-413e-b812-ab6ea7853df0 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.034288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a86db-d14e-413e-b812-ab6ea7853df0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.034561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a86db-d14e-413e-b812-ab6ea7853df0 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.036075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 513/1011] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:27.038656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3b805-c513-431d-9e1b-e30a0c602157 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:27.040997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1262b-8bae-4a30-9d83-e40396792234 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.041354 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1262b-8bae-4a30-9d83-e40396792234 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.041670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1262b-8bae-4a30-9d83-e40396792234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.061752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7da1262b-8bae-4a30-9d83-e40396792234 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:27.063570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7da1262b-8bae-4a30-9d83-e40396792234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:27.080516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:27.136931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 514/1012] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:27.155796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3b805-c513-431d-9e1b-e30a0c602157 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:27.194422 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d50c3-48d2-4df5-8b86-8f8a4a99be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:27.195039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d50c3-48d2-4df5-8b86-8f8a4a99be66 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.195348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d50c3-48d2-4df5-8b86-8f8a4a99be66 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.195620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d50c3-48d2-4df5-8b86-8f8a4a99be66 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.196260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d50c3-48d2-4df5-8b86-8f8a4a99be66 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:27.196561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d50c3-48d2-4df5-8b86-8f8a4a99be66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:27.197925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d50c3-48d2-4df5-8b86-8f8a4a99be66 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:27.207259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 499/1013] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:41:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:27.209688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1262b-8bae-4a30-9d83-e40396792234 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:27.307583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:27.315408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1262b-8bae-4a30-9d83-e40396792234 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:27.349114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25396-d684-4b53-b7ce-e106fd5f26c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:27.349796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25396-d684-4b53-b7ce-e106fd5f26c8 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.350136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25396-d684-4b53-b7ce-e106fd5f26c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.350467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25396-d684-4b53-b7ce-e106fd5f26c8 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.351164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b25396-d684-4b53-b7ce-e106fd5f26c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:27.351556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b25396-d684-4b53-b7ce-e106fd5f26c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:27.353019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b25396-d684-4b53-b7ce-e106fd5f26c8 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:27.362822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 515/1014] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Aug 22 19:41:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:27.364023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d50c3-48d2-4df5-8b86-8f8a4a99be66 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:27.418729 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25396-d684-4b53-b7ce-e106fd5f26c8 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:27.480697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:27.485307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d50c3-48d2-4df5-8b86-8f8a4a99be66 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:27.524636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b837413-c0af-4858-b6ab-2bd4948d1fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:27.525276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837413-c0af-4858-b6ab-2bd4948d1fb3 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.525511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837413-c0af-4858-b6ab-2bd4948d1fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.525786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837413-c0af-4858-b6ab-2bd4948d1fb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.526454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b837413-c0af-4858-b6ab-2bd4948d1fb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:27.527858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b837413-c0af-4858-b6ab-2bd4948d1fb3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:27.528559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25396-d684-4b53-b7ce-e106fd5f26c8 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:27.566993 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45fc99-6e93-4521-a673-dd58fb248472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:27.567645 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45fc99-6e93-4521-a673-dd58fb248472 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.567956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45fc99-6e93-4521-a673-dd58fb248472 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.568221 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45fc99-6e93-4521-a673-dd58fb248472 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.569325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45fc99-6e93-4521-a673-dd58fb248472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:27.570718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45fc99-6e93-4521-a673-dd58fb248472 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:27.572321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 516/1015] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:27.573416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66fa85-2aa0-4427-b6b2-8cde84fcb7b1 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.573690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66fa85-2aa0-4427-b6b2-8cde84fcb7b1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.573952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66fa85-2aa0-4427-b6b2-8cde84fcb7b1 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.575180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 517/1016] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:27.577908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66fa85-2aa0-4427-b6b2-8cde84fcb7b1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:27.598766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 500/1017] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:41:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:27.600038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b0a2-a2ff-4265-8d9b-0b465241d40b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.600319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b0a2-a2ff-4265-8d9b-0b465241d40b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.600642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b0a2-a2ff-4265-8d9b-0b465241d40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.615324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:27.626913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9cd3b0a2-a2ff-4265-8d9b-0b465241d40b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:27.628466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9cd3b0a2-a2ff-4265-8d9b-0b465241d40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:27.713754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 501/1018] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:27 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:27.714128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66fa85-2aa0-4427-b6b2-8cde84fcb7b1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:27.757248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712ee75-1398-4601-b710-9d78dc4f1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:27.757248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712ee75-1398-4601-b710-9d78dc4f1fa4 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:27.757517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712ee75-1398-4601-b710-9d78dc4f1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:27.757755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712ee75-1398-4601-b710-9d78dc4f1fa4 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:27.758298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712ee75-1398-4601-b710-9d78dc4f1fa4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:27.759780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712ee75-1398-4601-b710-9d78dc4f1fa4 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:27.842422 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 518/1019] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:41:27 2022] POST /identity/v3/projects => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:41:27.989079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b0a2-a2ff-4265-8d9b-0b465241d40b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:28.081422 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:28.101555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b0a2-a2ff-4265-8d9b-0b465241d40b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:28.138971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd0909-80a4-4991-8ea4-c8fb54b0588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:28.139686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd0909-80a4-4991-8ea4-c8fb54b0588d None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:28.139965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd0909-80a4-4991-8ea4-c8fb54b0588d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:28.140295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd0909-80a4-4991-8ea4-c8fb54b0588d None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:28.140991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd0909-80a4-4991-8ea4-c8fb54b0588d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:28.142865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd0909-80a4-4991-8ea4-c8fb54b0588d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:28.241724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 502/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:41:27 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:29.646201 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112ab49-14a8-4215-8dc8-edaaf927a35c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:29.646794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112ab49-14a8-4215-8dc8-edaaf927a35c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:29.646794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112ab49-14a8-4215-8dc8-edaaf927a35c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:29.648164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 519/1021] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:29.653285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed0cb5-06fa-48f5-8874-3de4e0479055 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:29.653702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed0cb5-06fa-48f5-8874-3de4e0479055 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:29.653844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed0cb5-06fa-48f5-8874-3de4e0479055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:29.673086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-41ed0cb5-06fa-48f5-8874-3de4e0479055 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:29.674311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-41ed0cb5-06fa-48f5-8874-3de4e0479055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:29.751129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 503/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:29.822540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9a0c9-a4a8-4f2b-a5ec-b477c11860f3 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:29.822902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9a0c9-a4a8-4f2b-a5ec-b477c11860f3 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:29.823088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9a0c9-a4a8-4f2b-a5ec-b477c11860f3 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:29.824763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 520/1023] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:29.830037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f5b37-7529-4b7a-bb0d-606510edaf01 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:29.830318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f5b37-7529-4b7a-bb0d-606510edaf01 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:29.830618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f5b37-7529-4b7a-bb0d-606510edaf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:29.849523 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-d01f5b37-7529-4b7a-bb0d-606510edaf01 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:29.850711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d01f5b37-7529-4b7a-bb0d-606510edaf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:29.912551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:29.920671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 504/1024] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:30.020038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9a0c9-a4a8-4f2b-a5ec-b477c11860f3 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.104416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:30.131334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9a0c9-a4a8-4f2b-a5ec-b477c11860f3 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:30.168101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a37fd-98b9-44f4-af3e-b53000bd20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:30.168660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a37fd-98b9-44f4-af3e-b53000bd20c2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.168942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a37fd-98b9-44f4-af3e-b53000bd20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.169218 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a37fd-98b9-44f4-af3e-b53000bd20c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.180259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff379b-9d6a-4133-9382-9c6269b79d8c None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.180548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff379b-9d6a-4133-9382-9c6269b79d8c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.180823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff379b-9d6a-4133-9382-9c6269b79d8c None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.181581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a37fd-98b9-44f4-af3e-b53000bd20c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:30.182314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 505/1025] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-936a37fd-98b9-44f4-af3e-b53000bd20c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:30.186686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:30.187696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:30.191121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:30.192317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a7e4-aa25-4666-9572-458148b23d8a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.192317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a7e4-aa25-4666-9572-458148b23d8a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.192317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a7e4-aa25-4666-9572-458148b23d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.192511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 521/1026] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 19:41:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:30.192789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a37fd-98b9-44f4-af3e-b53000bd20c2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.208803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-3212a7e4-aa25-4666-9572-458148b23d8a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:30.210014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3212a7e4-aa25-4666-9572-458148b23d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:30.282716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 506/1027] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:30.283609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a7e4-aa25-4666-9572-458148b23d8a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.297404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a37fd-98b9-44f4-af3e-b53000bd20c2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:30.334414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc24dfa-4b02-438d-a551-1b6db0a88fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:30.335008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc24dfa-4b02-438d-a551-1b6db0a88fe5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.335315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc24dfa-4b02-438d-a551-1b6db0a88fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.335592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc24dfa-4b02-438d-a551-1b6db0a88fe5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.336761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc24dfa-4b02-438d-a551-1b6db0a88fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:30.338285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc24dfa-4b02-438d-a551-1b6db0a88fe5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:30.340211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 522/1028] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:30.346463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc24dfa-4b02-438d-a551-1b6db0a88fe5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.349471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:30.393303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a7e4-aa25-4666-9572-458148b23d8a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:30.428555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:30.439455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e53a16-682b-44cd-9101-c8d9e46392ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:30.440553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e53a16-682b-44cd-9101-c8d9e46392ea None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.442012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e53a16-682b-44cd-9101-c8d9e46392ea None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.442012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e53a16-682b-44cd-9101-c8d9e46392ea None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.442880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e53a16-682b-44cd-9101-c8d9e46392ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:30.443363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e53a16-682b-44cd-9101-c8d9e46392ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:30.445413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e53a16-682b-44cd-9101-c8d9e46392ea None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:30.458898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 507/1029] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 19:41:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:30.463345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e53a16-682b-44cd-9101-c8d9e46392ea None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.466538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc24dfa-4b02-438d-a551-1b6db0a88fe5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:30.503496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721147e9-84c8-4f3a-9cc7-a9f6b09b9005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:30.504106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721147e9-84c8-4f3a-9cc7-a9f6b09b9005 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.504384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721147e9-84c8-4f3a-9cc7-a9f6b09b9005 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.504655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721147e9-84c8-4f3a-9cc7-a9f6b09b9005 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.505298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721147e9-84c8-4f3a-9cc7-a9f6b09b9005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:30.506774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721147e9-84c8-4f3a-9cc7-a9f6b09b9005 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:30.569245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e53a16-682b-44cd-9101-c8d9e46392ea None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:30.603389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b37be2-bce1-4a5b-8e9e-5cf58244f7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:30.604011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b37be2-bce1-4a5b-8e9e-5cf58244f7c9 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.604324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b37be2-bce1-4a5b-8e9e-5cf58244f7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.604595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b37be2-bce1-4a5b-8e9e-5cf58244f7c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.615207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b37be2-bce1-4a5b-8e9e-5cf58244f7c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:30.616715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b37be2-bce1-4a5b-8e9e-5cf58244f7c9 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:30.629578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 523/1030] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:41:30 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:41:30.630608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721147e9-84c8-4f3a-9cc7-a9f6b09b9005 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-78b37be2-bce1-4a5b-8e9e-5cf58244f7c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:30.631611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:30.637640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:30.638583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:30.638583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:30.638583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:30.638583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 508/1031] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:30.638826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b37be2-bce1-4a5b-8e9e-5cf58244f7c9 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.690463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:30.708326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:30.755528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721147e9-84c8-4f3a-9cc7-a9f6b09b9005 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:30.762460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b37be2-bce1-4a5b-8e9e-5cf58244f7c9 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:30.801258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff970-4749-41ef-8622-7959189a7c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:30.801900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff970-4749-41ef-8622-7959189a7c45 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.802182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff970-4749-41ef-8622-7959189a7c45 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.802454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff970-4749-41ef-8622-7959189a7c45 None admin] PATH_INFO: `/v3/services/image` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.803046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff970-4749-41ef-8622-7959189a7c45 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:30.804501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff970-4749-41ef-8622-7959189a7c45 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:30.806785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f49783-b862-468c-9d59-eb6ba4e86e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:30.807412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f49783-b862-468c-9d59-eb6ba4e86e5b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.807689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f49783-b862-468c-9d59-eb6ba4e86e5b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.807960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f49783-b862-468c-9d59-eb6ba4e86e5b None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.808611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f49783-b862-468c-9d59-eb6ba4e86e5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:30.808907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f49783-b862-468c-9d59-eb6ba4e86e5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:30.810739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f49783-b862-468c-9d59-eb6ba4e86e5b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-4cfff970-4749-41ef-8622-7959189a7c45 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:30.815649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:30.816642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:30.817501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 524/1032] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Aug 22 19:41:30 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:30.823858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff970-4749-41ef-8622-7959189a7c45 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.828660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 509/1033] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:30.834918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f49783-b862-468c-9d59-eb6ba4e86e5b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.937722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff970-4749-41ef-8622-7959189a7c45 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:30.941174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:30.943873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f49783-b862-468c-9d59-eb6ba4e86e5b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:30.962452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:30.976611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750241-0c06-4fae-9179-b3ebd6bf0615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:30.977228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750241-0c06-4fae-9179-b3ebd6bf0615 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.977508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750241-0c06-4fae-9179-b3ebd6bf0615 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.977784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7750241-0c06-4fae-9179-b3ebd6bf0615 None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.978425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750241-0c06-4fae-9179-b3ebd6bf0615 None admin] RBAC: Adding query filter params (name=image) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:30.978726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750241-0c06-4fae-9179-b3ebd6bf0615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:30.980144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7750241-0c06-4fae-9179-b3ebd6bf0615 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:30.983353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929417-932a-4bb7-8a40-1502e63421a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:30.984210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929417-932a-4bb7-8a40-1502e63421a5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:30.984688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929417-932a-4bb7-8a40-1502e63421a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:30.985197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929417-932a-4bb7-8a40-1502e63421a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:30.985324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 525/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:30.991076 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750241-0c06-4fae-9179-b3ebd6bf0615 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:30.993343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f929417-932a-4bb7-8a40-1502e63421a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:30.994918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f929417-932a-4bb7-8a40-1502e63421a5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-6f929417-932a-4bb7-8a40-1502e63421a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:31.007038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:31.008083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:31.009053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 510/1035] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 19:41:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:31.013698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929417-932a-4bb7-8a40-1502e63421a5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:31.100121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7750241-0c06-4fae-9179-b3ebd6bf0615 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:31.133454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929417-932a-4bb7-8a40-1502e63421a5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:31.137126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b05326-a044-4273-b956-3e1b28f8687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:31.137736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05326-a044-4273-b956-3e1b28f8687c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:31.138016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05326-a044-4273-b956-3e1b28f8687c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:31.138295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05326-a044-4273-b956-3e1b28f8687c None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:31.138929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b05326-a044-4273-b956-3e1b28f8687c None admin] RBAC: Adding query filter params (type=image) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:31.139252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b05326-a044-4273-b956-3e1b28f8687c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:31.140697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b05326-a044-4273-b956-3e1b28f8687c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:31.151252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 526/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:31.153292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b05326-a044-4273-b956-3e1b28f8687c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:31.176398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd69dc-83e2-4f51-9c8d-79f4e58dc6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:31.177019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd69dc-83e2-4f51-9c8d-79f4e58dc6bc None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:31.177309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd69dc-83e2-4f51-9c8d-79f4e58dc6bc None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:31.177568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd69dc-83e2-4f51-9c8d-79f4e58dc6bc None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:31.178318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd69dc-83e2-4f51-9c8d-79f4e58dc6bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:31.178611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd69dc-83e2-4f51-9c8d-79f4e58dc6bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:31.180082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd69dc-83e2-4f51-9c8d-79f4e58dc6bc None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:31.205896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 511/1037] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 19:41:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:31.206878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd69dc-83e2-4f51-9c8d-79f4e58dc6bc None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:31.213803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:31.228362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:31.266439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b05326-a044-4273-b956-3e1b28f8687c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:31.302299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71265a4d-5aac-495b-a007-273d243966f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:31.302908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71265a4d-5aac-495b-a007-273d243966f2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:31.303187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71265a4d-5aac-495b-a007-273d243966f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:31.303489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71265a4d-5aac-495b-a007-273d243966f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:31.304360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71265a4d-5aac-495b-a007-273d243966f2 None admin] RBAC: Adding query filter params (interface=public, service_id=3c406e21a1e040f6acffcb27ff189193, region_id=RegionOne) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:31.304675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71265a4d-5aac-495b-a007-273d243966f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:31.306073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71265a4d-5aac-495b-a007-273d243966f2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:31.317024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 527/1038] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 19:41:31 2022] GET /identity/v3/endpoints?service_id=3c406e21a1e040f6acffcb27ff189193&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:31.318123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71265a4d-5aac-495b-a007-273d243966f2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:31.318230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd69dc-83e2-4f51-9c8d-79f4e58dc6bc None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:31.354203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f60b4-1276-4c84-87bb-7c58d925c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:31.354814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f60b4-1276-4c84-87bb-7c58d925c723 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:31.355093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f60b4-1276-4c84-87bb-7c58d925c723 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:31.355397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f60b4-1276-4c84-87bb-7c58d925c723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:31.433042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f60b4-1276-4c84-87bb-7c58d925c723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:31.434501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f60b4-1276-4c84-87bb-7c58d925c723 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:31.442612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71265a4d-5aac-495b-a007-273d243966f2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:31.454520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:31.461122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:31.481709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06107c4-4aaa-4c42-a43d-67f01212353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:31.482319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06107c4-4aaa-4c42-a43d-67f01212353b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:31.482678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06107c4-4aaa-4c42-a43d-67f01212353b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:31.482914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06107c4-4aaa-4c42-a43d-67f01212353b None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:31.483558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06107c4-4aaa-4c42-a43d-67f01212353b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:31.485088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06107c4-4aaa-4c42-a43d-67f01212353b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:31.491812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 528/1039] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 19:41:31 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:41:31.557988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 512/1040] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 19:41:31.564715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06107c4-4aaa-4c42-a43d-67f01212353b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:31.684127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06107c4-4aaa-4c42-a43d-67f01212353b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:31.719959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a432ea-7fb2-491a-aae5-27340df29bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:31.720588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a432ea-7fb2-491a-aae5-27340df29bc1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:31.720819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a432ea-7fb2-491a-aae5-27340df29bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:31.721029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a432ea-7fb2-491a-aae5-27340df29bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:31.732637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a432ea-7fb2-491a-aae5-27340df29bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:31.734070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a432ea-7fb2-491a-aae5-27340df29bc1 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-d7a432ea-7fb2-491a-aae5-27340df29bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:31.748931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:31.749921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:31.751646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:31.751646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:31.751646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:31.751646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 529/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:31.757950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f60b4-1276-4c84-87bb-7c58d925c723 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:31.863791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f60b4-1276-4c84-87bb-7c58d925c723 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:31.881643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:31.898174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a1013-c91f-47e7-82f1-6052d9bb5222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:31.898771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a1013-c91f-47e7-82f1-6052d9bb5222 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:31.899047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a1013-c91f-47e7-82f1-6052d9bb5222 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:31.899553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a1013-c91f-47e7-82f1-6052d9bb5222 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:31.899983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a1013-c91f-47e7-82f1-6052d9bb5222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:31.900280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a1013-c91f-47e7-82f1-6052d9bb5222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:31.901632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a1013-c91f-47e7-82f1-6052d9bb5222 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:31.913594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 513/1042] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:31.918939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a432ea-7fb2-491a-aae5-27340df29bc1 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:31.950418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:32.026054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a432ea-7fb2-491a-aae5-27340df29bc1 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:32.061055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf73335-71e2-4b8c-b598-28f08dbf024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:32.061682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf73335-71e2-4b8c-b598-28f08dbf024a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:32.061956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf73335-71e2-4b8c-b598-28f08dbf024a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:32.062288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf73335-71e2-4b8c-b598-28f08dbf024a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:32.069525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf73335-71e2-4b8c-b598-28f08dbf024a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:32.070960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf73335-71e2-4b8c-b598-28f08dbf024a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-dbf73335-71e2-4b8c-b598-28f08dbf024a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:32.081856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:32.082768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:32.088118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:32.088118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:32.088118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:32.088118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:32.088118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:32.088118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:32.088118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:32.088118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:32.088118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 530/1043] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:32.090689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a1013-c91f-47e7-82f1-6052d9bb5222 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:32.195912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a1013-c91f-47e7-82f1-6052d9bb5222 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:32.230001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266521ac-df08-4902-9f9c-e261be78f126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:32.230603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266521ac-df08-4902-9f9c-e261be78f126 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:32.230881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266521ac-df08-4902-9f9c-e261be78f126 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:32.231149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266521ac-df08-4902-9f9c-e261be78f126 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:32.231863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266521ac-df08-4902-9f9c-e261be78f126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:32.232164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266521ac-df08-4902-9f9c-e261be78f126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:32.233584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266521ac-df08-4902-9f9c-e261be78f126 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:32.250862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 514/1044] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:32.252460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf73335-71e2-4b8c-b598-28f08dbf024a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:32.349678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:32.361112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf73335-71e2-4b8c-b598-28f08dbf024a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:32.403191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552fe9c-f2a1-4ae2-ad6f-1b7e575784bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:32.403837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552fe9c-f2a1-4ae2-ad6f-1b7e575784bc None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:32.404115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552fe9c-f2a1-4ae2-ad6f-1b7e575784bc None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:32.404387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552fe9c-f2a1-4ae2-ad6f-1b7e575784bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:32.405124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552fe9c-f2a1-4ae2-ad6f-1b7e575784bc None admin] RBAC: Adding query filter params (role.id=257229bcf1764aeab851927e4344336c, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1787fcb6f7c34de59c9682a4d8c3d2a3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:32.405487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552fe9c-f2a1-4ae2-ad6f-1b7e575784bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:32.407313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552fe9c-f2a1-4ae2-ad6f-1b7e575784bc None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:32.423466 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 531/1045] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:32 2022] GET /identity/v3/role_assignments?user.id=1787fcb6f7c34de59c9682a4d8c3d2a3&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=257229bcf1764aeab851927e4344336c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:32.632485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ead3c-37b4-450f-9149-ae3ca061c8d2 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:32.632783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ead3c-37b4-450f-9149-ae3ca061c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:32.632968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ead3c-37b4-450f-9149-ae3ca061c8d2 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:32.634452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 515/1046] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:32.639674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d762bc-647c-4fdd-bf30-a1e864d360d4 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:32.640027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d762bc-647c-4fdd-bf30-a1e864d360d4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:32.640367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d762bc-647c-4fdd-bf30-a1e864d360d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:32.658758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b8d762bc-647c-4fdd-bf30-a1e864d360d4 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:32.659970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b8d762bc-647c-4fdd-bf30-a1e864d360d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:32.729654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 532/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:32.998250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ead3c-37b4-450f-9149-ae3ca061c8d2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:33.043878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:33.109310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ead3c-37b4-450f-9149-ae3ca061c8d2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:33.143980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a396f-d542-4f40-898f-c8adfc8b0301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:33.144609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a396f-d542-4f40-898f-c8adfc8b0301 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:33.144885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a396f-d542-4f40-898f-c8adfc8b0301 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:33.145152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a396f-d542-4f40-898f-c8adfc8b0301 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:33.155897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a396f-d542-4f40-898f-c8adfc8b0301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-869a396f-d542-4f40-898f-c8adfc8b0301 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:33.161396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:33.162323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:33.163161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 516/1048] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:33.169117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d762bc-647c-4fdd-bf30-a1e864d360d4 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:33.254813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:33.272987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d762bc-647c-4fdd-bf30-a1e864d360d4 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:33.308526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c2f3-5b14-495b-8f90-a2ea98f20ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:33.309135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c2f3-5b14-495b-8f90-a2ea98f20ce2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:33.309417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c2f3-5b14-495b-8f90-a2ea98f20ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:33.309686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c2f3-5b14-495b-8f90-a2ea98f20ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:33.310351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c2f3-5b14-495b-8f90-a2ea98f20ce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:33.310684 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c2f3-5b14-495b-8f90-a2ea98f20ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:33.312074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c2f3-5b14-495b-8f90-a2ea98f20ce2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:33.321016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 533/1049] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:33.326731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a396f-d542-4f40-898f-c8adfc8b0301 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:33.444025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e490a3d-b823-48e8-ab5a-61804b77de24 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:33.444336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e490a3d-b823-48e8-ab5a-61804b77de24 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:33.444580 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e490a3d-b823-48e8-ab5a-61804b77de24 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:33.445934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 534/1050] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:33.447165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:33.450829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4d32-5288-4c60-99c7-c4a5ebd2a671 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:33.451120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4d32-5288-4c60-99c7-c4a5ebd2a671 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:33.451421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4d32-5288-4c60-99c7-c4a5ebd2a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:33.453919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a396f-d542-4f40-898f-c8adfc8b0301 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:33.470918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0e9f4d32-5288-4c60-99c7-c4a5ebd2a671 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:33.472153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0e9f4d32-5288-4c60-99c7-c4a5ebd2a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:33.493691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d757da2-21f7-400b-84e7-6156d1413196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:33.494325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d757da2-21f7-400b-84e7-6156d1413196 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:33.494604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d757da2-21f7-400b-84e7-6156d1413196 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:33.494879 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d757da2-21f7-400b-84e7-6156d1413196 None admin] PATH_INFO: `/v3/users/a5419f205c1d41e79da0604639c82272` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:33.509864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d757da2-21f7-400b-84e7-6156d1413196 None admin] RBAC: Authorizing `identity:get_user(user_id=a5419f205c1d41e79da0604639c82272)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:33.511303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d757da2-21f7-400b-84e7-6156d1413196 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:33.517991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 517/1051] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:41:33 2022] GET /identity/v3/users/a5419f205c1d41e79da0604639c82272 => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:33.518835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d757da2-21f7-400b-84e7-6156d1413196 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:33.554519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 535/1052] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:33.621218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d757da2-21f7-400b-84e7-6156d1413196 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:33.656600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671668c2-2985-4b46-9331-19fd0057ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:33.657202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671668c2-2985-4b46-9331-19fd0057ca77 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:33.657480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671668c2-2985-4b46-9331-19fd0057ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:33.657749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671668c2-2985-4b46-9331-19fd0057ca77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:33.682379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:33.727292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671668c2-2985-4b46-9331-19fd0057ca77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:33.728758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671668c2-2985-4b46-9331-19fd0057ca77 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:33.836420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 518/1053] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 19:41:33.836595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4d32-5288-4c60-99c7-c4a5ebd2a671 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:33.838244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671668c2-2985-4b46-9331-19fd0057ca77 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:33.900912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:33.919448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:33.944156 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4d32-5288-4c60-99c7-c4a5ebd2a671 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:33.950284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671668c2-2985-4b46-9331-19fd0057ca77 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:33.979772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355725-b77b-4acc-a54b-cad415a7b9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:33.980419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355725-b77b-4acc-a54b-cad415a7b9c7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:33.980697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355725-b77b-4acc-a54b-cad415a7b9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:33.980965 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355725-b77b-4acc-a54b-cad415a7b9c7 None admin] PATH_INFO: `/v3/services/image` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:33.981550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23355725-b77b-4acc-a54b-cad415a7b9c7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:33.982921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23355725-b77b-4acc-a54b-cad415a7b9c7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:33.990543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db7d4-71aa-4236-9ceb-05d43863096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:33.991383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db7d4-71aa-4236-9ceb-05d43863096d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:33.991832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db7d4-71aa-4236-9ceb-05d43863096d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:33.992254 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db7d4-71aa-4236-9ceb-05d43863096d None admin] PATH_INFO: `/v3/projects/85d3e153472444ddbdd5f569879d1e5c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-23355725-b77b-4acc-a54b-cad415a7b9c7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:33.992368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:33.993471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:33.994296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 536/1054] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Aug 22 19:41:33 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:33.996537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382db7d4-71aa-4236-9ceb-05d43863096d None admin] RBAC: Authorizing `identity:get_project(project_id=85d3e153472444ddbdd5f569879d1e5c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:33.997986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382db7d4-71aa-4236-9ceb-05d43863096d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:33.999722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 519/1055] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:41:33 2022] GET /identity/v3/projects/85d3e153472444ddbdd5f569879d1e5c => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:34.001451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355725-b77b-4acc-a54b-cad415a7b9c7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:34.009434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db7d4-71aa-4236-9ceb-05d43863096d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:34.111936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355725-b77b-4acc-a54b-cad415a7b9c7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:34.114706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db7d4-71aa-4236-9ceb-05d43863096d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:34.140714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:34.148335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee37c-4467-4771-8f8e-162b19b3cc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:34.152842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee37c-4467-4771-8f8e-162b19b3cc3f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:34.152842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee37c-4467-4771-8f8e-162b19b3cc3f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:34.152842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ee37c-4467-4771-8f8e-162b19b3cc3f None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:34.152842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ee37c-4467-4771-8f8e-162b19b3cc3f None admin] RBAC: Adding query filter params (name=image) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:34.152842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ee37c-4467-4771-8f8e-162b19b3cc3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:34.152842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ee37c-4467-4771-8f8e-162b19b3cc3f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:34.154217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4c0fd-f921-4256-8e2c-cf14fa24e490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:34.155007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c0fd-f921-4256-8e2c-cf14fa24e490 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:34.155322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c0fd-f921-4256-8e2c-cf14fa24e490 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:34.155606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4c0fd-f921-4256-8e2c-cf14fa24e490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:34.156365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c0fd-f921-4256-8e2c-cf14fa24e490 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=85d3e153472444ddbdd5f569879d1e5c, user.id=a5419f205c1d41e79da0604639c82272) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:34.156672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c0fd-f921-4256-8e2c-cf14fa24e490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:34.161941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 537/1056] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:34.162110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4c0fd-f921-4256-8e2c-cf14fa24e490 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:34.163701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee37c-4467-4771-8f8e-162b19b3cc3f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:34.175251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 520/1057] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:34 2022] GET /identity/v3/role_assignments?user.id=a5419f205c1d41e79da0604639c82272&scope.project.id=85d3e153472444ddbdd5f569879d1e5c&role.id=9ec7f759c0a64655b794dfb597930076 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:34.175471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:34.280840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ee37c-4467-4771-8f8e-162b19b3cc3f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:34.319840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68d41-39f9-4ee9-92a0-424f2740d989 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:34.320241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68d41-39f9-4ee9-92a0-424f2740d989 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:34.320435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68d41-39f9-4ee9-92a0-424f2740d989 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:34.320868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300273-b099-4913-a46f-666c956834cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:34.321476 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300273-b099-4913-a46f-666c956834cf None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:34.321749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300273-b099-4913-a46f-666c956834cf None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:34.322927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 521/1058] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:34.323055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300273-b099-4913-a46f-666c956834cf None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:34.323055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300273-b099-4913-a46f-666c956834cf None admin] RBAC: Adding query filter params (type=image) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:34.323055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300273-b099-4913-a46f-666c956834cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:34.324462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300273-b099-4913-a46f-666c956834cf None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:34.328272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc335a78-a98f-41bf-b22a-9c50e8dbd2b7 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:34.329448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc335a78-a98f-41bf-b22a-9c50e8dbd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:34.330041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc335a78-a98f-41bf-b22a-9c50e8dbd2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:34.330668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 538/1059] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:34.336172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300273-b099-4913-a46f-666c956834cf None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:34.372943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fc335a78-a98f-41bf-b22a-9c50e8dbd2b7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:34.374044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fc335a78-a98f-41bf-b22a-9c50e8dbd2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:34.437431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:34.457631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 522/1060] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:34.475456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300273-b099-4913-a46f-666c956834cf None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:34.511059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a92da-0bff-4357-ac34-471f3c9ebb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:34.511688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a92da-0bff-4357-ac34-471f3c9ebb39 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:34.511971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a92da-0bff-4357-ac34-471f3c9ebb39 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:34.512299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a92da-0bff-4357-ac34-471f3c9ebb39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:34.512956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a92da-0bff-4357-ac34-471f3c9ebb39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:34.514388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a92da-0bff-4357-ac34-471f3c9ebb39 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:34.587270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 539/1061] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:41:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:41:34.727267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc335a78-a98f-41bf-b22a-9c50e8dbd2b7 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:34.835655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc335a78-a98f-41bf-b22a-9c50e8dbd2b7 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:34.852902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:34.876608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16fc3-c81a-4b6f-a8e1-e574ec35867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:34.877238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16fc3-c81a-4b6f-a8e1-e574ec35867b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:34.877512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16fc3-c81a-4b6f-a8e1-e574ec35867b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:34.877779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16fc3-c81a-4b6f-a8e1-e574ec35867b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:34.888138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb16fc3-c81a-4b6f-a8e1-e574ec35867b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-5bb16fc3-c81a-4b6f-a8e1-e574ec35867b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:34.893212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:34.894331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:34.895389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:34.902492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 523/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 19:41:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:34.903987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a92da-0bff-4357-ac34-471f3c9ebb39 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:35.009628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a92da-0bff-4357-ac34-471f3c9ebb39 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:35.033562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:35.044628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0e143-d8de-40b7-84dc-24db0931740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:35.045236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0e143-d8de-40b7-84dc-24db0931740f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:35.045510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0e143-d8de-40b7-84dc-24db0931740f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:35.045772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0e143-d8de-40b7-84dc-24db0931740f None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:35.046434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0e143-d8de-40b7-84dc-24db0931740f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:35.046732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0e143-d8de-40b7-84dc-24db0931740f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:35.048966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0e143-d8de-40b7-84dc-24db0931740f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:35.062982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 540/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 19:41:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:35.064459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16fc3-c81a-4b6f-a8e1-e574ec35867b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:35.171901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16fc3-c81a-4b6f-a8e1-e574ec35867b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:35.207132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353daeaa-6e98-410a-a660-d55c769a2b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:35.207784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353daeaa-6e98-410a-a660-d55c769a2b2a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:35.208059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353daeaa-6e98-410a-a660-d55c769a2b2a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:35.208327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353daeaa-6e98-410a-a660-d55c769a2b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:35.218489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353daeaa-6e98-410a-a660-d55c769a2b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:35.220842 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353daeaa-6e98-410a-a660-d55c769a2b2a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-353daeaa-6e98-410a-a660-d55c769a2b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:35.235928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:35.236979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:35.243311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:35.243311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:35.243311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:35.243311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 524/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:35.245066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0e143-d8de-40b7-84dc-24db0931740f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:35.347493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0e143-d8de-40b7-84dc-24db0931740f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:35.411906 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6679-37af-47ea-9252-488dc4ffb325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:35.412521 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6679-37af-47ea-9252-488dc4ffb325 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:35.412800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6679-37af-47ea-9252-488dc4ffb325 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:35.413129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6679-37af-47ea-9252-488dc4ffb325 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:35.413781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6679-37af-47ea-9252-488dc4ffb325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:35.414086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6679-37af-47ea-9252-488dc4ffb325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:35.415490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6679-37af-47ea-9252-488dc4ffb325 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:35.428286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 541/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:35.436426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353daeaa-6e98-410a-a660-d55c769a2b2a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:35.468489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:35.546565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353daeaa-6e98-410a-a660-d55c769a2b2a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:35.584812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76266e-a551-4406-94bf-7a7816f7bc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:35.585452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76266e-a551-4406-94bf-7a7816f7bc36 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:35.585763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76266e-a551-4406-94bf-7a7816f7bc36 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:35.586054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76266e-a551-4406-94bf-7a7816f7bc36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:35.600416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76266e-a551-4406-94bf-7a7816f7bc36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:35.602183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76266e-a551-4406-94bf-7a7816f7bc36 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-4b76266e-a551-4406-94bf-7a7816f7bc36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:35.614767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:35.616747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:41:35.618946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:35.623164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 525/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 19:41:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:35.625205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6679-37af-47ea-9252-488dc4ffb325 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:35.676109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:35.732573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6679-37af-47ea-9252-488dc4ffb325 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:35.770031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83700b55-5e11-4cfa-85d4-07280bfe32d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:35.770647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83700b55-5e11-4cfa-85d4-07280bfe32d8 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:35.770931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83700b55-5e11-4cfa-85d4-07280bfe32d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:35.771198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83700b55-5e11-4cfa-85d4-07280bfe32d8 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:35.771964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83700b55-5e11-4cfa-85d4-07280bfe32d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:35.772289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83700b55-5e11-4cfa-85d4-07280bfe32d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:35.773721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83700b55-5e11-4cfa-85d4-07280bfe32d8 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:35.791982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 542/1067] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 19:41:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:35.798167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76266e-a551-4406-94bf-7a7816f7bc36 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:35.885202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:35.900066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76266e-a551-4406-94bf-7a7816f7bc36 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:35.934975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5af6c-5ed5-44e3-b76f-c27f6a8cf1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:35.935643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5af6c-5ed5-44e3-b76f-c27f6a8cf1e4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:35.935920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5af6c-5ed5-44e3-b76f-c27f6a8cf1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:35.936190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5af6c-5ed5-44e3-b76f-c27f6a8cf1e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:35.947519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5af6c-5ed5-44e3-b76f-c27f6a8cf1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:35.948970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5af6c-5ed5-44e3-b76f-c27f6a8cf1e4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-a2a5af6c-5ed5-44e3-b76f-c27f6a8cf1e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:35.964288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:35.965341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:35.966242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:35.966242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:35.966242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:35.970810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 526/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:35.972194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83700b55-5e11-4cfa-85d4-07280bfe32d8 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:36.074000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83700b55-5e11-4cfa-85d4-07280bfe32d8 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:36.076423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:36.082260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532bbc7-48fc-471f-af46-cd64ff3ef60a None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.082734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532bbc7-48fc-471f-af46-cd64ff3ef60a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.082811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532bbc7-48fc-471f-af46-cd64ff3ef60a None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.084255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 527/1069] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:36.089108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1e88d-c09d-48ef-b40a-6deac60743fe None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.089385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1e88d-c09d-48ef-b40a-6deac60743fe None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.089659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1e88d-c09d-48ef-b40a-6deac60743fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.108142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9ff1e88d-c09d-48ef-b40a-6deac60743fe None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:36.109313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9ff1e88d-c09d-48ef-b40a-6deac60743fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:36.114064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70528bec-7ccf-4de4-9ef8-c66097c90ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:36.114680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70528bec-7ccf-4de4-9ef8-c66097c90ad3 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.114959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70528bec-7ccf-4de4-9ef8-c66097c90ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.115265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70528bec-7ccf-4de4-9ef8-c66097c90ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.115988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70528bec-7ccf-4de4-9ef8-c66097c90ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:36.116286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70528bec-7ccf-4de4-9ef8-c66097c90ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:36.118072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70528bec-7ccf-4de4-9ef8-c66097c90ad3 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:36.132142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 543/1070] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:36.137749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70528bec-7ccf-4de4-9ef8-c66097c90ad3 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:36.185635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 528/1071] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:36.245374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70528bec-7ccf-4de4-9ef8-c66097c90ad3 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:36.280390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b5e5-ce02-44c8-8ce6-688254f18498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:36.281014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b5e5-ce02-44c8-8ce6-688254f18498 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.281312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b5e5-ce02-44c8-8ce6-688254f18498 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.281579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76b5e5-ce02-44c8-8ce6-688254f18498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.288515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76b5e5-ce02-44c8-8ce6-688254f18498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:36.290014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76b5e5-ce02-44c8-8ce6-688254f18498 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-ac76b5e5-ce02-44c8-8ce6-688254f18498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:36.301904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:36.302804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:36.308661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:36.308661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:36.308661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:36.308661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:36.308661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:36.308661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:36.308661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:36.308661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:36.308661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 544/1072] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:36.310587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1e88d-c09d-48ef-b40a-6deac60743fe None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:36.381234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:36.421728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1e88d-c09d-48ef-b40a-6deac60743fe None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:36.456199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b5e5-ce02-44c8-8ce6-688254f18498 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:36.456612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72089-b83f-4bdd-9ec8-49f59da0748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:36.457163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72089-b83f-4bdd-9ec8-49f59da0748c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.457437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72089-b83f-4bdd-9ec8-49f59da0748c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.457705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f72089-b83f-4bdd-9ec8-49f59da0748c None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.458390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72089-b83f-4bdd-9ec8-49f59da0748c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:36.458692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72089-b83f-4bdd-9ec8-49f59da0748c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:36.460159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f72089-b83f-4bdd-9ec8-49f59da0748c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:36.477452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 529/1073] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:36.478466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72089-b83f-4bdd-9ec8-49f59da0748c None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:36.488171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:36.567707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76b5e5-ce02-44c8-8ce6-688254f18498 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:36.585541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f72089-b83f-4bdd-9ec8-49f59da0748c None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:36.605298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6f101-5d30-4ddf-b3c7-bc33d7f4799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:36.605922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6f101-5d30-4ddf-b3c7-bc33d7f4799b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.606202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6f101-5d30-4ddf-b3c7-bc33d7f4799b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.606465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6f101-5d30-4ddf-b3c7-bc33d7f4799b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.613073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:36.616930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6f101-5d30-4ddf-b3c7-bc33d7f4799b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:36.620884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f672f0-ffa6-4314-b6ed-03283081f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:36.621535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f672f0-ffa6-4314-b6ed-03283081f492 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-e3c6f101-5d30-4ddf-b3c7-bc33d7f4799b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:36.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:36.628579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:41:36.629535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:36.630177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f672f0-ffa6-4314-b6ed-03283081f492 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.630177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f672f0-ffa6-4314-b6ed-03283081f492 None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1787fcb6f7c34de59c9682a4d8c3d2a3/roles/257229bcf1764aeab851927e4344336c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.630306 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 545/1074] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:41:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:36.630306 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c68e-13d5-41bc-853f-018056f6e23f None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.630306 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c68e-13d5-41bc-853f-018056f6e23f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.630505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f672f0-ffa6-4314-b6ed-03283081f492 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=1787fcb6f7c34de59c9682a4d8c3d2a3, role_id=257229bcf1764aeab851927e4344336c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:36.630604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c68e-13d5-41bc-853f-018056f6e23f None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.630604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 546/1075] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:36.630726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f672f0-ffa6-4314-b6ed-03283081f492 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:36.632011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045c68e-13d5-41bc-853f-018056f6e23f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:36.716785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:36.720009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 530/1076] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:41:36 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1787fcb6f7c34de59c9682a4d8c3d2a3/roles/257229bcf1764aeab851927e4344336c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:41:36.721232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce07ecf-68b6-4ef7-b6f5-a78cec5d0863 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.721515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce07ecf-68b6-4ef7-b6f5-a78cec5d0863 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.721783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce07ecf-68b6-4ef7-b6f5-a78cec5d0863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.742353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-5ce07ecf-68b6-4ef7-b6f5-a78cec5d0863 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:36.743650 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5ce07ecf-68b6-4ef7-b6f5-a78cec5d0863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:36.747953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045c68e-13d5-41bc-853f-018056f6e23f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:36.786229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd43ff-2d14-4e5d-981a-e12a67a7f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:36.786855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd43ff-2d14-4e5d-981a-e12a67a7f74c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.787139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd43ff-2d14-4e5d-981a-e12a67a7f74c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.787440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd43ff-2d14-4e5d-981a-e12a67a7f74c None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.788123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd43ff-2d14-4e5d-981a-e12a67a7f74c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:36.788422 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd43ff-2d14-4e5d-981a-e12a67a7f74c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:36.789842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd43ff-2d14-4e5d-981a-e12a67a7f74c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:36.800187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 547/1077] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:41:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:36.806065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd43ff-2d14-4e5d-981a-e12a67a7f74c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:36.826966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 531/1078] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:36.928893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd43ff-2d14-4e5d-981a-e12a67a7f74c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:36.963983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39e18f-e742-4483-a5f8-8c7dcc54caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:36.964614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39e18f-e742-4483-a5f8-8c7dcc54caa4 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:36.964890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39e18f-e742-4483-a5f8-8c7dcc54caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:36.965160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39e18f-e742-4483-a5f8-8c7dcc54caa4 None admin] PATH_INFO: `/v3/users/a5419f205c1d41e79da0604639c82272` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:36.966296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39e18f-e742-4483-a5f8-8c7dcc54caa4 None admin] RBAC: Authorizing `identity:get_user(user_id=a5419f205c1d41e79da0604639c82272)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:36.967828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39e18f-e742-4483-a5f8-8c7dcc54caa4 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:36.969590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 548/1079] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:41:36 2022] GET /identity/v3/users/a5419f205c1d41e79da0604639c82272 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:36.975638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce07ecf-68b6-4ef7-b6f5-a78cec5d0863 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:37.079206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce07ecf-68b6-4ef7-b6f5-a78cec5d0863 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:37.097607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:37.101619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39e18f-e742-4483-a5f8-8c7dcc54caa4 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:37.119175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:37.121398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd9ea-7ee0-49c7-b569-59cc978edd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:37.122103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd9ea-7ee0-49c7-b569-59cc978edd84 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:37.122449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd9ea-7ee0-49c7-b569-59cc978edd84 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:37.122827 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dd9ea-7ee0-49c7-b569-59cc978edd84 None admin] PATH_INFO: `/v3/projects/85d3e153472444ddbdd5f569879d1e5c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:37.123962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dd9ea-7ee0-49c7-b569-59cc978edd84 None admin] RBAC: Authorizing `identity:get_project(project_id=85d3e153472444ddbdd5f569879d1e5c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:37.126007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dd9ea-7ee0-49c7-b569-59cc978edd84 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:37.133959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 532/1080] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:41:36 2022] GET /identity/v3/projects/85d3e153472444ddbdd5f569879d1e5c => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:37.135020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd9ea-7ee0-49c7-b569-59cc978edd84 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:37.215328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39e18f-e742-4483-a5f8-8c7dcc54caa4 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:37.241031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dd9ea-7ee0-49c7-b569-59cc978edd84 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:37.252525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853052d-2bd6-4570-952a-986d5463642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:37.253396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853052d-2bd6-4570-952a-986d5463642a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:37.253669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853052d-2bd6-4570-952a-986d5463642a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:37.253934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853052d-2bd6-4570-952a-986d5463642a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:37.277246 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1aa42-7ecd-4de4-a19c-3bc18025b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:37.277901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1aa42-7ecd-4de4-a19c-3bc18025b949 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:37.278184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1aa42-7ecd-4de4-a19c-3bc18025b949 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:37.278458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1aa42-7ecd-4de4-a19c-3bc18025b949 None admin] PATH_INFO: `/v3/projects/85d3e153472444ddbdd5f569879d1e5c/users/a5419f205c1d41e79da0604639c82272/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:37.280546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1aa42-7ecd-4de4-a19c-3bc18025b949 None admin] RBAC: Authorizing `identity:create_grant(project_id=85d3e153472444ddbdd5f569879d1e5c, user_id=a5419f205c1d41e79da0604639c82272, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:37.282751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1aa42-7ecd-4de4-a19c-3bc18025b949 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:37.322678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853052d-2bd6-4570-952a-986d5463642a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:37.324164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853052d-2bd6-4570-952a-986d5463642a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:37.339703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:37.347140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 533/1081] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:41:37 2022] PUT /identity/v3/projects/85d3e153472444ddbdd5f569879d1e5c/users/a5419f205c1d41e79da0604639c82272/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:41:37.452909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 549/1082] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 19:41:37.455153 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1aa42-7ecd-4de4-a19c-3bc18025b949 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:37.511276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:37.565818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1aa42-7ecd-4de4-a19c-3bc18025b949 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:37.601305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42698ec-eaee-4c49-a683-faa33327d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:37.601938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42698ec-eaee-4c49-a683-faa33327d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:37.602212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42698ec-eaee-4c49-a683-faa33327d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:37.602479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42698ec-eaee-4c49-a683-faa33327d2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:37.614017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42698ec-eaee-4c49-a683-faa33327d2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:37.615691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42698ec-eaee-4c49-a683-faa33327d2e6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-b42698ec-eaee-4c49-a683-faa33327d2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:37.636349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:37.637359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:37.638887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:37.638887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:37.638887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:37.638887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 534/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:37.644210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853052d-2bd6-4570-952a-986d5463642a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:37.754305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853052d-2bd6-4570-952a-986d5463642a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:37.768804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:37.789721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71616574-d77a-4686-b1f8-7a645fccf421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:37.790332 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71616574-d77a-4686-b1f8-7a645fccf421 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:37.790609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71616574-d77a-4686-b1f8-7a645fccf421 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:37.790878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71616574-d77a-4686-b1f8-7a645fccf421 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:37.791594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71616574-d77a-4686-b1f8-7a645fccf421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:37.791905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71616574-d77a-4686-b1f8-7a645fccf421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:37.793268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71616574-d77a-4686-b1f8-7a645fccf421 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:37.807313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 550/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:38.651414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f073ea-cee7-43ff-a5d1-95ae5cd88ff2 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:38.651927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f073ea-cee7-43ff-a5d1-95ae5cd88ff2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:38.651927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f073ea-cee7-43ff-a5d1-95ae5cd88ff2 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:38.653201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 535/1085] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:38.658649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f7893-ee54-490a-a269-254fa7709194 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:38.659074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f7893-ee54-490a-a269-254fa7709194 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:38.659293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f7893-ee54-490a-a269-254fa7709194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:38.677283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d21f7893-ee54-490a-a269-254fa7709194 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:38.678455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d21f7893-ee54-490a-a269-254fa7709194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:38.745047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 551/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:39.010822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f073ea-cee7-43ff-a5d1-95ae5cd88ff2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:39.112503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:39.117755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f073ea-cee7-43ff-a5d1-95ae5cd88ff2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:39.152788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f5df3-3279-46ed-88c7-e29612e4711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:39.153412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f5df3-3279-46ed-88c7-e29612e4711b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.153687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f5df3-3279-46ed-88c7-e29612e4711b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.153953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f5df3-3279-46ed-88c7-e29612e4711b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.164854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f5df3-3279-46ed-88c7-e29612e4711b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-f66f5df3-3279-46ed-88c7-e29612e4711b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:39.169503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:39.170576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:39.171460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 536/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:39.176933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f7893-ee54-490a-a269-254fa7709194 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:39.273366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f7893-ee54-490a-a269-254fa7709194 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:39.275619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:39.308218 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7fb67-f215-4f03-9630-4d3e54ea4616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:39.308825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7fb67-f215-4f03-9630-4d3e54ea4616 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.309100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7fb67-f215-4f03-9630-4d3e54ea4616 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.309369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7fb67-f215-4f03-9630-4d3e54ea4616 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.310036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7fb67-f215-4f03-9630-4d3e54ea4616 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:39.310341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7fb67-f215-4f03-9630-4d3e54ea4616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:39.312008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7fb67-f215-4f03-9630-4d3e54ea4616 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:39.312169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1510c4-4b71-402e-8496-81edc110818a None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.312455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1510c4-4b71-402e-8496-81edc110818a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.312814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1510c4-4b71-402e-8496-81edc110818a None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.314087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 537/1088] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:41:39.320359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb81f5-4d83-40e8-b8ff-137b4a4f36a3 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.325067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb81f5-4d83-40e8-b8ff-137b4a4f36a3 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.325219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 552/1089] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:39.325327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb81f5-4d83-40e8-b8ff-137b4a4f36a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.326075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7fb67-f215-4f03-9630-4d3e54ea4616 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:39.339748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-cffb81f5-4d83-40e8-b8ff-137b4a4f36a3 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:39.340942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cffb81f5-4d83-40e8-b8ff-137b4a4f36a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:39.409938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 538/1090] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:41:39.430699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7fb67-f215-4f03-9630-4d3e54ea4616 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:39.464434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdae52-56fd-4414-aedf-23ea70b9bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:39.465052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdae52-56fd-4414-aedf-23ea70b9bf2e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.465325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdae52-56fd-4414-aedf-23ea70b9bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.465590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdae52-56fd-4414-aedf-23ea70b9bf2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.476682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdae52-56fd-4414-aedf-23ea70b9bf2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:39.478107 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdae52-56fd-4414-aedf-23ea70b9bf2e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-9acdae52-56fd-4414-aedf-23ea70b9bf2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:39.492062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:39.493056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:39.493959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:39.493959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:39.493959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:39.493959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 553/1091] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:39.499114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb81f5-4d83-40e8-b8ff-137b4a4f36a3 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:39.587935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:39.599496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb81f5-4d83-40e8-b8ff-137b4a4f36a3 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:39.634688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947ae64-0284-4b59-a00a-3907815541cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:39.635319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947ae64-0284-4b59-a00a-3907815541cb None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.635598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947ae64-0284-4b59-a00a-3907815541cb None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.635873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947ae64-0284-4b59-a00a-3907815541cb None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.636517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947ae64-0284-4b59-a00a-3907815541cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:39.636817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947ae64-0284-4b59-a00a-3907815541cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:39.638219 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947ae64-0284-4b59-a00a-3907815541cb None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:39.650295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 539/1092] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:39.655952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdae52-56fd-4414-aedf-23ea70b9bf2e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:39.678899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947ae64-0284-4b59-a00a-3907815541cb None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:39.684255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:39.770308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdae52-56fd-4414-aedf-23ea70b9bf2e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:39.780540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947ae64-0284-4b59-a00a-3907815541cb None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:39.805165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f169c-a36e-4134-a8f5-b1e057fd973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:39.805791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f169c-a36e-4134-a8f5-b1e057fd973a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.806067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f169c-a36e-4134-a8f5-b1e057fd973a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.806334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f169c-a36e-4134-a8f5-b1e057fd973a None admin] PATH_INFO: `/v3/users/nova` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.813425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f169c-a36e-4134-a8f5-b1e057fd973a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:39.814407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0048539-f742-4ba4-9aab-851914d15614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:39.814874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f169c-a36e-4134-a8f5-b1e057fd973a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:39.815029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0048539-f742-4ba4-9aab-851914d15614 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.815339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0048539-f742-4ba4-9aab-851914d15614 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.815608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0048539-f742-4ba4-9aab-851914d15614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.825911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0048539-f742-4ba4-9aab-851914d15614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-ca5f169c-a36e-4134-a8f5-b1e057fd973a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:41:39.826243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:39.832166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:39.833180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 554/1093] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-b0048539-f742-4ba4-9aab-851914d15614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:41:39.833763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:39.834649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:41:39.835501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 540/1094] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:39.836211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f169c-a36e-4134-a8f5-b1e057fd973a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:39.838284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0048539-f742-4ba4-9aab-851914d15614 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:39.849603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:39.914649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:39.935816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f169c-a36e-4134-a8f5-b1e057fd973a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:39.939800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0048539-f742-4ba4-9aab-851914d15614 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:39.971742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6ac7-607b-440f-94cf-2f69f4b9f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:39.972352 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6ac7-607b-440f-94cf-2f69f4b9f57e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.972633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6ac7-607b-440f-94cf-2f69f4b9f57e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.972905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6ac7-607b-440f-94cf-2f69f4b9f57e None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.973639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd6ac7-607b-440f-94cf-2f69f4b9f57e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:39.973945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd6ac7-607b-440f-94cf-2f69f4b9f57e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:39.975150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7966-c903-47b3-bae8-3a14141d8297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:39.975441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd6ac7-607b-440f-94cf-2f69f4b9f57e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:39.975867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7966-c903-47b3-bae8-3a14141d8297 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:39.976137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7966-c903-47b3-bae8-3a14141d8297 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:39.976413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7966-c903-47b3-bae8-3a14141d8297 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:39.977075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc7966-c903-47b3-bae8-3a14141d8297 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:39.977380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc7966-c903-47b3-bae8-3a14141d8297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:39.978730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc7966-c903-47b3-bae8-3a14141d8297 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:39.987416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 541/1095] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:39.993197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7966-c903-47b3-bae8-3a14141d8297 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:39.993959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 555/1096] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:39.999254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6ac7-607b-440f-94cf-2f69f4b9f57e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:40.062404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:40.093824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7966-c903-47b3-bae8-3a14141d8297 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:40.100464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6ac7-607b-440f-94cf-2f69f4b9f57e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:40.130038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8ba50-d2c4-43a9-a25a-faf0802db5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:40.130670 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8ba50-d2c4-43a9-a25a-faf0802db5a8 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:40.130970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8ba50-d2c4-43a9-a25a-faf0802db5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:40.131217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8ba50-d2c4-43a9-a25a-faf0802db5a8 None admin] PATH_INFO: `/v3/users/a5419f205c1d41e79da0604639c82272` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:40.132404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8ba50-d2c4-43a9-a25a-faf0802db5a8 None admin] RBAC: Authorizing `identity:get_user(user_id=a5419f205c1d41e79da0604639c82272)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:40.133846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8ba50-d2c4-43a9-a25a-faf0802db5a8 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:40.135477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 542/1097] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/users/a5419f205c1d41e79da0604639c82272 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:40.137805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb3ec9-3f2b-49a1-b502-1c5656fb9c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:40.138417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb3ec9-3f2b-49a1-b502-1c5656fb9c20 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:40.138695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb3ec9-3f2b-49a1-b502-1c5656fb9c20 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:40.138966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb3ec9-3f2b-49a1-b502-1c5656fb9c20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:40.141232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8ba50-d2c4-43a9-a25a-faf0802db5a8 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:40.142536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:40.208164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb3ec9-3f2b-49a1-b502-1c5656fb9c20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:40.209627 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb3ec9-3f2b-49a1-b502-1c5656fb9c20 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:40.241009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8ba50-d2c4-43a9-a25a-faf0802db5a8 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:40.274300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03156d-61ec-4748-a3d0-a52a3a7674e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:40.274911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03156d-61ec-4748-a3d0-a52a3a7674e5 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:40.275189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03156d-61ec-4748-a3d0-a52a3a7674e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:40.275504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03156d-61ec-4748-a3d0-a52a3a7674e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:40.284935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:40.310541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 556/1098] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 19:41:40.316347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb3ec9-3f2b-49a1-b502-1c5656fb9c20 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:40.348814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03156d-61ec-4748-a3d0-a52a3a7674e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:40.350034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:40.350171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03156d-61ec-4748-a3d0-a52a3a7674e5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:40.419332 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb3ec9-3f2b-49a1-b502-1c5656fb9c20 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:40.454470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 543/1099] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 19:41:40.455708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab53e9b-c59b-4873-8b6c-163220353360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:40.456345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab53e9b-c59b-4873-8b6c-163220353360 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:40.456622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab53e9b-c59b-4873-8b6c-163220353360 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:40.456891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab53e9b-c59b-4873-8b6c-163220353360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:40.460493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03156d-61ec-4748-a3d0-a52a3a7674e5 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:40.467474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab53e9b-c59b-4873-8b6c-163220353360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:40.469443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab53e9b-c59b-4873-8b6c-163220353360 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-cab53e9b-c59b-4873-8b6c-163220353360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:41:40.484161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:40.485930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:41:40.486828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:41:40.486828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:41:40.486828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:40.486828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 557/1100] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:40.491755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab53e9b-c59b-4873-8b6c-163220353360 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:40.500712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:40.563199 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03156d-61ec-4748-a3d0-a52a3a7674e5 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:40.583522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:40.596232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab53e9b-c59b-4873-8b6c-163220353360 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:40.599107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe555f0d-f92e-469b-a400-74d10b9e70a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:40.599703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555f0d-f92e-469b-a400-74d10b9e70a2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:40.599981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555f0d-f92e-469b-a400-74d10b9e70a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:40.600252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555f0d-f92e-469b-a400-74d10b9e70a2 None admin] PATH_INFO: `/v3/projects/85d3e153472444ddbdd5f569879d1e5c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:40.601377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe555f0d-f92e-469b-a400-74d10b9e70a2 None admin] RBAC: Authorizing `identity:get_project(project_id=85d3e153472444ddbdd5f569879d1e5c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:40.602811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe555f0d-f92e-469b-a400-74d10b9e70a2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:40.604753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 544/1101] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:41:40 2022] GET /identity/v3/projects/85d3e153472444ddbdd5f569879d1e5c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:40.611470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe555f0d-f92e-469b-a400-74d10b9e70a2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:40.631366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8bd7f-11d2-4af1-b478-acffb691cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:40.631997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8bd7f-11d2-4af1-b478-acffb691cd80 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:40.632271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8bd7f-11d2-4af1-b478-acffb691cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:40.636350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8bd7f-11d2-4af1-b478-acffb691cd80 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:40.636350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8bd7f-11d2-4af1-b478-acffb691cd80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:40.636350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8bd7f-11d2-4af1-b478-acffb691cd80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:40.636350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8bd7f-11d2-4af1-b478-acffb691cd80 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:40.646663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 558/1102] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:40.652218 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8bd7f-11d2-4af1-b478-acffb691cd80 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:40.715336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe555f0d-f92e-469b-a400-74d10b9e70a2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:40.724063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:40.751420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e353dcd-0f51-4e61-a4db-3c76ab2752f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:40.752013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e353dcd-0f51-4e61-a4db-3c76ab2752f4 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:40.752305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e353dcd-0f51-4e61-a4db-3c76ab2752f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:40.752558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e353dcd-0f51-4e61-a4db-3c76ab2752f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:40.753535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e353dcd-0f51-4e61-a4db-3c76ab2752f4 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=85d3e153472444ddbdd5f569879d1e5c, user.id=a5419f205c1d41e79da0604639c82272) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:40.753839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e353dcd-0f51-4e61-a4db-3c76ab2752f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:40.755281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e353dcd-0f51-4e61-a4db-3c76ab2752f4 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:40.756181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8bd7f-11d2-4af1-b478-acffb691cd80 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:40.761706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 545/1103] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:40 2022] GET /identity/v3/role_assignments?user.id=a5419f205c1d41e79da0604639c82272&scope.project.id=85d3e153472444ddbdd5f569879d1e5c&role.id=9ec7f759c0a64655b794dfb597930076 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:41:40.794606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cf5c1-6490-43ab-ac1d-6ca1ff94f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:40.795289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cf5c1-6490-43ab-ac1d-6ca1ff94f31b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:40.795572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cf5c1-6490-43ab-ac1d-6ca1ff94f31b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:40.795851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cf5c1-6490-43ab-ac1d-6ca1ff94f31b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:40.804075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cf5c1-6490-43ab-ac1d-6ca1ff94f31b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:40.805557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cf5c1-6490-43ab-ac1d-6ca1ff94f31b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-bb8cf5c1-6490-43ab-ac1d-6ca1ff94f31b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:41:40.818358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:41:40.819564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:41:40.820638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:41:40.820638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:41:40.820638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:41:40.820638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:41:40.820638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:41:40.820638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:41:40.820638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:41:40.820638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:41:40.823404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 559/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 19:41:40.825677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e353dcd-0f51-4e61-a4db-3c76ab2752f4 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:40.934696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e353dcd-0f51-4e61-a4db-3c76ab2752f4 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:40.970150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714779ae-72b6-4cb7-a909-c0aa47fd9f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:40.970761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714779ae-72b6-4cb7-a909-c0aa47fd9f40 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:40.971043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714779ae-72b6-4cb7-a909-c0aa47fd9f40 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:40.971341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714779ae-72b6-4cb7-a909-c0aa47fd9f40 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:40.972038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714779ae-72b6-4cb7-a909-c0aa47fd9f40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:40.972342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714779ae-72b6-4cb7-a909-c0aa47fd9f40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:40.973778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714779ae-72b6-4cb7-a909-c0aa47fd9f40 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:40.985442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 546/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:41:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:40.991640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cf5c1-6490-43ab-ac1d-6ca1ff94f31b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:41.004070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:41.094648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cf5c1-6490-43ab-ac1d-6ca1ff94f31b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:41.130182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06242abd-6f37-43b3-9f9a-ae64bdfb10f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:41.130787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06242abd-6f37-43b3-9f9a-ae64bdfb10f9 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:41.131062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06242abd-6f37-43b3-9f9a-ae64bdfb10f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:41.131362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06242abd-6f37-43b3-9f9a-ae64bdfb10f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:41.132084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06242abd-6f37-43b3-9f9a-ae64bdfb10f9 None admin] RBAC: Adding query filter params (role.id=257229bcf1764aeab851927e4344336c, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1787fcb6f7c34de59c9682a4d8c3d2a3) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:41.132386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06242abd-6f37-43b3-9f9a-ae64bdfb10f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:41.133806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06242abd-6f37-43b3-9f9a-ae64bdfb10f9 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:41.139629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 560/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:40 2022] GET /identity/v3/role_assignments?user.id=1787fcb6f7c34de59c9682a4d8c3d2a3&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=257229bcf1764aeab851927e4344336c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:42.711469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c92d-f509-447a-8a71-f8c874d209f0 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:42.712006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c92d-f509-447a-8a71-f8c874d209f0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:42.712006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01c92d-f509-447a-8a71-f8c874d209f0 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:42.713478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 547/1107] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:42.718744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1752a-9d6f-4225-b46d-3ff4764fc3c1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:42.719750 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1752a-9d6f-4225-b46d-3ff4764fc3c1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:42.719836 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1752a-9d6f-4225-b46d-3ff4764fc3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:42.738228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-61b1752a-9d6f-4225-b46d-3ff4764fc3c1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:42.739435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-61b1752a-9d6f-4225-b46d-3ff4764fc3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:42.804517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 561/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:43.077635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01c92d-f509-447a-8a71-f8c874d209f0 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:43.111269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:43.181310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01c92d-f509-447a-8a71-f8c874d209f0 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:43.213994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b06ab-6022-46a9-99a0-34667401ffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:43.214613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b06ab-6022-46a9-99a0-34667401ffce None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:43.214886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b06ab-6022-46a9-99a0-34667401ffce None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:43.215150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b06ab-6022-46a9-99a0-34667401ffce None admin] PATH_INFO: `/v3/domains/default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:43.216264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b06ab-6022-46a9-99a0-34667401ffce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:43.217680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b06ab-6022-46a9-99a0-34667401ffce None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:43.219918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 548/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:43.225677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1752a-9d6f-4225-b46d-3ff4764fc3c1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:43.227876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:43.325480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1752a-9d6f-4225-b46d-3ff4764fc3c1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:43.358947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99655bfa-e999-42ce-8966-b2db5dea58d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:43.360244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655bfa-e999-42ce-8966-b2db5dea58d5 None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:43.360569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655bfa-e999-42ce-8966-b2db5dea58d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:43.360873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655bfa-e999-42ce-8966-b2db5dea58d5 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:43.361527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99655bfa-e999-42ce-8966-b2db5dea58d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:43.363003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99655bfa-e999-42ce-8966-b2db5dea58d5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:43.478027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 562/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:41:43 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:45.460566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c28e48-4e87-414e-8d09-9dbdd64afc64 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:45.461061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c28e48-4e87-414e-8d09-9dbdd64afc64 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:45.461152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c28e48-4e87-414e-8d09-9dbdd64afc64 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:45.462450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 549/1111] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:45.468180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf2f4-2ee7-448e-808f-77e0c72ee304 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:45.468619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf2f4-2ee7-448e-808f-77e0c72ee304 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:45.468713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdf2f4-2ee7-448e-808f-77e0c72ee304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:45.488262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3efdf2f4-2ee7-448e-808f-77e0c72ee304 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:45.489439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3efdf2f4-2ee7-448e-808f-77e0c72ee304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:45.542536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:45.556903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 563/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:45.825628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c28e48-4e87-414e-8d09-9dbdd64afc64 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:45.921709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:45.926951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c28e48-4e87-414e-8d09-9dbdd64afc64 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:45.961151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a7768-8947-4a75-bcfa-513cc769d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:45.961768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a7768-8947-4a75-bcfa-513cc769d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:45.962045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a7768-8947-4a75-bcfa-513cc769d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:45.962315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a7768-8947-4a75-bcfa-513cc769d3d3 None admin] PATH_INFO: `/v3/roles/25294da9af854bf181e95bc99a9818c8` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:45.963778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a7768-8947-4a75-bcfa-513cc769d3d3 None admin] RBAC: Authorizing `identity:get_role(role_id=25294da9af854bf181e95bc99a9818c8)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:45.965155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a7768-8947-4a75-bcfa-513cc769d3d3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:45.966466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 550/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:41:45 2022] GET /identity/v3/roles/25294da9af854bf181e95bc99a9818c8 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:45.972870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdf2f4-2ee7-448e-808f-77e0c72ee304 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:46.070317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdf2f4-2ee7-448e-808f-77e0c72ee304 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:46.103948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d61315-a020-43ad-91bc-978136e67cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:46.104503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d61315-a020-43ad-91bc-978136e67cdf None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:46.104776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d61315-a020-43ad-91bc-978136e67cdf None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:46.105050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d61315-a020-43ad-91bc-978136e67cdf None admin] PATH_INFO: `/v3/users/bd98a6f8ee0e42fa90ccec7f4dc43b25` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:46.117885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d61315-a020-43ad-91bc-978136e67cdf None admin] RBAC: Authorizing `identity:get_user(user_id=bd98a6f8ee0e42fa90ccec7f4dc43b25)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:46.119340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d61315-a020-43ad-91bc-978136e67cdf None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:46.120937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 564/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:41:45 2022] GET /identity/v3/users/bd98a6f8ee0e42fa90ccec7f4dc43b25 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:46.127114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a7768-8947-4a75-bcfa-513cc769d3d3 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:46.226093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a7768-8947-4a75-bcfa-513cc769d3d3 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:46.260058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecae25c-9a94-4dce-a20a-c8fbf093844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:46.260648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecae25c-9a94-4dce-a20a-c8fbf093844c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:46.260927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecae25c-9a94-4dce-a20a-c8fbf093844c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:46.261194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecae25c-9a94-4dce-a20a-c8fbf093844c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:46.294394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:46.327805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecae25c-9a94-4dce-a20a-c8fbf093844c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:46.329337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecae25c-9a94-4dce-a20a-c8fbf093844c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:46.499733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 551/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:41:46.506050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d61315-a020-43ad-91bc-978136e67cdf None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:46.552858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:46.604492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d61315-a020-43ad-91bc-978136e67cdf None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:46.638081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05eee0-45f3-4cbd-81bf-481264dd02a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:46.638697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05eee0-45f3-4cbd-81bf-481264dd02a6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:46.638974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05eee0-45f3-4cbd-81bf-481264dd02a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:46.639264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05eee0-45f3-4cbd-81bf-481264dd02a6 None admin] PATH_INFO: `/v3/projects/85d3e153472444ddbdd5f569879d1e5c` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:46.640374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05eee0-45f3-4cbd-81bf-481264dd02a6 None admin] RBAC: Authorizing `identity:get_project(project_id=85d3e153472444ddbdd5f569879d1e5c)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:46.642529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05eee0-45f3-4cbd-81bf-481264dd02a6 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:46.644183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 565/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:41:46 2022] GET /identity/v3/projects/85d3e153472444ddbdd5f569879d1e5c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:46.650589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecae25c-9a94-4dce-a20a-c8fbf093844c None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:46.713934 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:46.748253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecae25c-9a94-4dce-a20a-c8fbf093844c None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:46.782405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f2a8a-c038-4cd3-b30e-a531cddc210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:46.782993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f2a8a-c038-4cd3-b30e-a531cddc210b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:46.783295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f2a8a-c038-4cd3-b30e-a531cddc210b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:46.783570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f2a8a-c038-4cd3-b30e-a531cddc210b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:46.784291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f2a8a-c038-4cd3-b30e-a531cddc210b None admin] RBAC: Adding query filter params (role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=85d3e153472444ddbdd5f569879d1e5c, user.id=bd98a6f8ee0e42fa90ccec7f4dc43b25) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:46.784596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f2a8a-c038-4cd3-b30e-a531cddc210b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:46.786017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f2a8a-c038-4cd3-b30e-a531cddc210b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:46.791261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 552/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:46 2022] GET /identity/v3/role_assignments?user.id=bd98a6f8ee0e42fa90ccec7f4dc43b25&scope.project.id=85d3e153472444ddbdd5f569879d1e5c&role.id=25294da9af854bf181e95bc99a9818c8 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:48.660451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635088-d8d2-4625-8124-f0e31c769f91 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:48.661002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635088-d8d2-4625-8124-f0e31c769f91 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:48.661002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635088-d8d2-4625-8124-f0e31c769f91 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:48.662322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 566/1118] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:48.667590 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8927c0-1951-4c13-b974-8aae72976c64 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:48.668020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8927c0-1951-4c13-b974-8aae72976c64 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:48.668121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8927c0-1951-4c13-b974-8aae72976c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:48.686557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ab8927c0-1951-4c13-b974-8aae72976c64 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:48.688287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ab8927c0-1951-4c13-b974-8aae72976c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:48.753479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 553/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:49.024531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63635088-d8d2-4625-8124-f0e31c769f91 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:49.125595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63635088-d8d2-4625-8124-f0e31c769f91 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:49.139833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:49.160174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56744d1-ec04-43a0-838b-2d2a6a62d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:49.160799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56744d1-ec04-43a0-838b-2d2a6a62d419 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:49.161157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56744d1-ec04-43a0-838b-2d2a6a62d419 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:49.161338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56744d1-ec04-43a0-838b-2d2a6a62d419 None admin] PATH_INFO: `/v3/roles/25294da9af854bf181e95bc99a9818c8` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:49.162723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56744d1-ec04-43a0-838b-2d2a6a62d419 None admin] RBAC: Authorizing `identity:get_role(role_id=25294da9af854bf181e95bc99a9818c8)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:49.164121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56744d1-ec04-43a0-838b-2d2a6a62d419 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:49.165443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 567/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:41:49 2022] GET /identity/v3/roles/25294da9af854bf181e95bc99a9818c8 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:49.171292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8927c0-1951-4c13-b974-8aae72976c64 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:49.230243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:49.270913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8927c0-1951-4c13-b974-8aae72976c64 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:49.303128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25d8ec-666f-4e31-9459-0ef0800a26bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:49.303709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d8ec-666f-4e31-9459-0ef0800a26bf None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:49.303983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d8ec-666f-4e31-9459-0ef0800a26bf None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:49.304251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d8ec-666f-4e31-9459-0ef0800a26bf None admin] PATH_INFO: `/v3/users/bd98a6f8ee0e42fa90ccec7f4dc43b25` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:49.305342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25d8ec-666f-4e31-9459-0ef0800a26bf None admin] RBAC: Authorizing `identity:get_user(user_id=bd98a6f8ee0e42fa90ccec7f4dc43b25)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:49.306764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25d8ec-666f-4e31-9459-0ef0800a26bf None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:49.308356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 554/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:41:49 2022] GET /identity/v3/users/bd98a6f8ee0e42fa90ccec7f4dc43b25 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:49.314928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56744d1-ec04-43a0-838b-2d2a6a62d419 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:49.413374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56744d1-ec04-43a0-838b-2d2a6a62d419 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:49.448608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67490c5-5ed5-4310-9fe3-6cee5a9c800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:49.449231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67490c5-5ed5-4310-9fe3-6cee5a9c800e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:49.449505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67490c5-5ed5-4310-9fe3-6cee5a9c800e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:49.449770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67490c5-5ed5-4310-9fe3-6cee5a9c800e None admin] PATH_INFO: `/v3/projects/85d3e153472444ddbdd5f569879d1e5c` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:49.450860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67490c5-5ed5-4310-9fe3-6cee5a9c800e None admin] RBAC: Authorizing `identity:get_project(project_id=85d3e153472444ddbdd5f569879d1e5c)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:49.452488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67490c5-5ed5-4310-9fe3-6cee5a9c800e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:49.455113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 568/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:41:49 2022] GET /identity/v3/projects/85d3e153472444ddbdd5f569879d1e5c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:49.461095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25d8ec-666f-4e31-9459-0ef0800a26bf None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:49.557890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25d8ec-666f-4e31-9459-0ef0800a26bf None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:49.584815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:49.592347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62981b-df91-4fc9-b066-d193cea04c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:49.596811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62981b-df91-4fc9-b066-d193cea04c54 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:49.596811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62981b-df91-4fc9-b066-d193cea04c54 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:49.596811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62981b-df91-4fc9-b066-d193cea04c54 None admin] PATH_INFO: `/v3/projects/85d3e153472444ddbdd5f569879d1e5c/users/bd98a6f8ee0e42fa90ccec7f4dc43b25/roles/25294da9af854bf181e95bc99a9818c8` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:49.596811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62981b-df91-4fc9-b066-d193cea04c54 None admin] RBAC: Authorizing `identity:create_grant(project_id=85d3e153472444ddbdd5f569879d1e5c, user_id=bd98a6f8ee0e42fa90ccec7f4dc43b25, role_id=25294da9af854bf181e95bc99a9818c8)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:49.597342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62981b-df91-4fc9-b066-d193cea04c54 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:49.685341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 555/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:41:49 2022] PUT /identity/v3/projects/85d3e153472444ddbdd5f569879d1e5c/users/bd98a6f8ee0e42fa90ccec7f4dc43b25/roles/25294da9af854bf181e95bc99a9818c8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:41:51.556167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec706b-f14a-42c0-bb30-a83d4aef8b74 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:51.556719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec706b-f14a-42c0-bb30-a83d4aef8b74 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:51.556719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec706b-f14a-42c0-bb30-a83d4aef8b74 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:51.558049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 569/1124] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:51.563125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5b3d-bf28-4e7f-8870-139dbec118e0 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:51.563571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5b3d-bf28-4e7f-8870-139dbec118e0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:51.563682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef5b3d-bf28-4e7f-8870-139dbec118e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:51.581455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fdef5b3d-bf28-4e7f-8870-139dbec118e0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:51.582706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fdef5b3d-bf28-4e7f-8870-139dbec118e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:51.648372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 556/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:51.917834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec706b-f14a-42c0-bb30-a83d4aef8b74 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:51.968461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:52.018090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec706b-f14a-42c0-bb30-a83d4aef8b74 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:52.050890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc3c5f-52a6-4dd4-9fdb-54b52f7c3fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:52.051530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc3c5f-52a6-4dd4-9fdb-54b52f7c3fd4 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:52.051805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc3c5f-52a6-4dd4-9fdb-54b52f7c3fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:52.052068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc3c5f-52a6-4dd4-9fdb-54b52f7c3fd4 None admin] PATH_INFO: `/v3/roles/25294da9af854bf181e95bc99a9818c8` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:52.053429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc3c5f-52a6-4dd4-9fdb-54b52f7c3fd4 None admin] RBAC: Authorizing `identity:get_role(role_id=25294da9af854bf181e95bc99a9818c8)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:52.054781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc3c5f-52a6-4dd4-9fdb-54b52f7c3fd4 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:52.056117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 570/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:41:51 2022] GET /identity/v3/roles/25294da9af854bf181e95bc99a9818c8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:52.061865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5b3d-bf28-4e7f-8870-139dbec118e0 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:52.161356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef5b3d-bf28-4e7f-8870-139dbec118e0 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:52.178267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:52.194653 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0546-5e9d-4663-ab4c-3975f57b05f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:52.195298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0546-5e9d-4663-ab4c-3975f57b05f1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:52.195573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0546-5e9d-4663-ab4c-3975f57b05f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:52.195840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced0546-5e9d-4663-ab4c-3975f57b05f1 None admin] PATH_INFO: `/v3/users/bd98a6f8ee0e42fa90ccec7f4dc43b25` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:52.196946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced0546-5e9d-4663-ab4c-3975f57b05f1 None admin] RBAC: Authorizing `identity:get_user(user_id=bd98a6f8ee0e42fa90ccec7f4dc43b25)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:52.198402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced0546-5e9d-4663-ab4c-3975f57b05f1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:52.200003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 557/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:41:52 2022] GET /identity/v3/users/bd98a6f8ee0e42fa90ccec7f4dc43b25 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:52.206641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc3c5f-52a6-4dd4-9fdb-54b52f7c3fd4 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:52.304873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc3c5f-52a6-4dd4-9fdb-54b52f7c3fd4 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:52.323690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:52.341081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1280-9a0e-409d-a1f1-cc6204dc650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:52.341704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1280-9a0e-409d-a1f1-cc6204dc650a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:52.342020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1280-9a0e-409d-a1f1-cc6204dc650a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:52.342362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1280-9a0e-409d-a1f1-cc6204dc650a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:52.409385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf1280-9a0e-409d-a1f1-cc6204dc650a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:52.410843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf1280-9a0e-409d-a1f1-cc6204dc650a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:52.520356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 571/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:41:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:41:52.526449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0546-5e9d-4663-ab4c-3975f57b05f1 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:52.633363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced0546-5e9d-4663-ab4c-3975f57b05f1 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:52.669695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24d9cd-53ab-43c1-82a0-d21a1607226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:52.670316 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24d9cd-53ab-43c1-82a0-d21a1607226d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:52.670593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24d9cd-53ab-43c1-82a0-d21a1607226d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:52.670864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24d9cd-53ab-43c1-82a0-d21a1607226d None admin] PATH_INFO: `/v3/projects/85d3e153472444ddbdd5f569879d1e5c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:52.672792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24d9cd-53ab-43c1-82a0-d21a1607226d None admin] RBAC: Authorizing `identity:get_project(project_id=85d3e153472444ddbdd5f569879d1e5c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:52.674227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24d9cd-53ab-43c1-82a0-d21a1607226d None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:52.675890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 558/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:41:52 2022] GET /identity/v3/projects/85d3e153472444ddbdd5f569879d1e5c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:52.682867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1280-9a0e-409d-a1f1-cc6204dc650a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:52.703483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:52.793423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1280-9a0e-409d-a1f1-cc6204dc650a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:52.829475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4431dc-7172-4bfa-81b4-aed5f90ed8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:52.830091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4431dc-7172-4bfa-81b4-aed5f90ed8ef None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:52.830368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4431dc-7172-4bfa-81b4-aed5f90ed8ef None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:52.830636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4431dc-7172-4bfa-81b4-aed5f90ed8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:52.831391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4431dc-7172-4bfa-81b4-aed5f90ed8ef None admin] RBAC: Adding query filter params (role.id=25294da9af854bf181e95bc99a9818c8, scope.project.id=85d3e153472444ddbdd5f569879d1e5c, user.id=bd98a6f8ee0e42fa90ccec7f4dc43b25) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:41:52.831722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4431dc-7172-4bfa-81b4-aed5f90ed8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:52.833311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4431dc-7172-4bfa-81b4-aed5f90ed8ef None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:52.839668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 572/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:41:52 2022] GET /identity/v3/role_assignments?user.id=bd98a6f8ee0e42fa90ccec7f4dc43b25&scope.project.id=85d3e153472444ddbdd5f569879d1e5c&role.id=25294da9af854bf181e95bc99a9818c8 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:54.775658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd0f51-cc6c-4fe6-992b-475669e1a4a5 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:54.776191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd0f51-cc6c-4fe6-992b-475669e1a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:54.776191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd0f51-cc6c-4fe6-992b-475669e1a4a5 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:54.777542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 559/1131] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:54.783601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ef861-df73-43d9-b855-dad5d17ab03e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:54.784033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ef861-df73-43d9-b855-dad5d17ab03e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:54.784127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ef861-df73-43d9-b855-dad5d17ab03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:54.802575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-773ef861-df73-43d9-b855-dad5d17ab03e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:54.803785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-773ef861-df73-43d9-b855-dad5d17ab03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:54.868204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 573/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:55.135672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd0f51-cc6c-4fe6-992b-475669e1a4a5 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:55.193384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:55.237388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd0f51-cc6c-4fe6-992b-475669e1a4a5 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:55.270752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d892d-648c-4dfb-8f63-75f5a4f250f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:55.271412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d892d-648c-4dfb-8f63-75f5a4f250f9 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:55.271693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d892d-648c-4dfb-8f63-75f5a4f250f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:55.271964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d892d-648c-4dfb-8f63-75f5a4f250f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:55.273073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d892d-648c-4dfb-8f63-75f5a4f250f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:55.274515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d892d-648c-4dfb-8f63-75f5a4f250f9 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:55.276124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 560/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:55.282628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ef861-df73-43d9-b855-dad5d17ab03e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:55.296762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:55.381298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ef861-df73-43d9-b855-dad5d17ab03e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:55.417118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8514c-8b07-4a85-a9ab-871f1acc4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:55.417719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8514c-8b07-4a85-a9ab-871f1acc4c7e None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:55.417992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8514c-8b07-4a85-a9ab-871f1acc4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:55.418256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8514c-8b07-4a85-a9ab-871f1acc4c7e None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:55.418972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8514c-8b07-4a85-a9ab-871f1acc4c7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:55.420359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8514c-8b07-4a85-a9ab-871f1acc4c7e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:55.526686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 574/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:41:55 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:41:57.443879 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08867b-5d79-473a-bdbb-bebe1e2e7432 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:57.444408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08867b-5d79-473a-bdbb-bebe1e2e7432 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:57.444408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08867b-5d79-473a-bdbb-bebe1e2e7432 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:57.445732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 561/1135] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:41:57.451034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44baf-663f-46fa-a3d1-d7cab5c58f70 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:57.451479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44baf-663f-46fa-a3d1-d7cab5c58f70 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:57.451625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b44baf-663f-46fa-a3d1-d7cab5c58f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:57.470834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f4b44baf-663f-46fa-a3d1-d7cab5c58f70 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:41:57.472056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f4b44baf-663f-46fa-a3d1-d7cab5c58f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:41:57.529688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:57.538106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 575/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:41:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:41:57.806198 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08867b-5d79-473a-bdbb-bebe1e2e7432 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:57.908572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08867b-5d79-473a-bdbb-bebe1e2e7432 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:57.930746 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:41:57.942287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0f443-96b9-4ef0-94f1-4a5015351311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:57.944728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0f443-96b9-4ef0-94f1-4a5015351311 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:57.944728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0f443-96b9-4ef0-94f1-4a5015351311 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:57.944728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0f443-96b9-4ef0-94f1-4a5015351311 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:57.944728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0f443-96b9-4ef0-94f1-4a5015351311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:57.945943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0f443-96b9-4ef0-94f1-4a5015351311 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:57.947522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 562/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:41:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:41:57.953191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44baf-663f-46fa-a3d1-d7cab5c58f70 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:41:58.049081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b44baf-663f-46fa-a3d1-d7cab5c58f70 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:41:58.081984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d34ad-ead1-4ca6-ae82-25a880b2094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:41:58.082514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d34ad-ead1-4ca6-ae82-25a880b2094a None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:41:58.082789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d34ad-ead1-4ca6-ae82-25a880b2094a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:41:58.083055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d34ad-ead1-4ca6-ae82-25a880b2094a None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:41:58.083724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d34ad-ead1-4ca6-ae82-25a880b2094a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:41:58.085141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d34ad-ead1-4ca6-ae82-25a880b2094a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:41:58.162884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 576/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:41:57 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:42:00.111959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b5a3-893b-4fed-aa93-3000b54a077a None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:00.112499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b5a3-893b-4fed-aa93-3000b54a077a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:00.112499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b5a3-893b-4fed-aa93-3000b54a077a None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:00.113830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 563/1139] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:00.119031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a79ea-82de-4ac2-80d9-b31b7e2d15a6 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:00.119621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a79ea-82de-4ac2-80d9-b31b7e2d15a6 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:00.119621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a79ea-82de-4ac2-80d9-b31b7e2d15a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:00.138203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d13a79ea-82de-4ac2-80d9-b31b7e2d15a6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:00.139423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d13a79ea-82de-4ac2-80d9-b31b7e2d15a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:00.185562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:00.206083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 577/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:42:00.479905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b5a3-893b-4fed-aa93-3000b54a077a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:00.580301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b5a3-893b-4fed-aa93-3000b54a077a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:00.614131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd9217-e688-4888-8342-c20ea612826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:00.614747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd9217-e688-4888-8342-c20ea612826e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:00.615023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd9217-e688-4888-8342-c20ea612826e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:00.615321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd9217-e688-4888-8342-c20ea612826e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:00.625982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd9217-e688-4888-8342-c20ea612826e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-38dd9217-e688-4888-8342-c20ea612826e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:42:00.631150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:42:00.632311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:42:00.633591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 564/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:42:00.638286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a79ea-82de-4ac2-80d9-b31b7e2d15a6 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:00.737066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a79ea-82de-4ac2-80d9-b31b7e2d15a6 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:00.771810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baff248-30dd-4f77-ab09-cc973a24b2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:00.772465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baff248-30dd-4f77-ab09-cc973a24b2d5 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:00.772747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baff248-30dd-4f77-ab09-cc973a24b2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:00.773020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baff248-30dd-4f77-ab09-cc973a24b2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:00.773686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baff248-30dd-4f77-ab09-cc973a24b2d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:00.773989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baff248-30dd-4f77-ab09-cc973a24b2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:00.775387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baff248-30dd-4f77-ab09-cc973a24b2d5 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:00.783325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 578/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:42:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:00.789158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd9217-e688-4888-8342-c20ea612826e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:00.839475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:00.888095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd9217-e688-4888-8342-c20ea612826e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:00.921610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c60d87-4b6e-4fe0-8581-6d687169fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:00.922771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60d87-4b6e-4fe0-8581-6d687169fb2c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:00.923146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60d87-4b6e-4fe0-8581-6d687169fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:00.923422 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60d87-4b6e-4fe0-8581-6d687169fb2c None admin] PATH_INFO: `/v3/users/c09242a5766243c4a86dc1cef2741e60` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:00.936224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c60d87-4b6e-4fe0-8581-6d687169fb2c None admin] RBAC: Authorizing `identity:get_user(user_id=c09242a5766243c4a86dc1cef2741e60)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:00.937657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c60d87-4b6e-4fe0-8581-6d687169fb2c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:00.939917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 565/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:42:00 2022] GET /identity/v3/users/c09242a5766243c4a86dc1cef2741e60 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:00.945775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baff248-30dd-4f77-ab09-cc973a24b2d5 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:00.988167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:01.044121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baff248-30dd-4f77-ab09-cc973a24b2d5 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:01.077898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61542a-5c46-4d9e-aba3-cb93d1058f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:01.078676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61542a-5c46-4d9e-aba3-cb93d1058f37 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:01.078995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61542a-5c46-4d9e-aba3-cb93d1058f37 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:01.079725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61542a-5c46-4d9e-aba3-cb93d1058f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:01.145662 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61542a-5c46-4d9e-aba3-cb93d1058f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:01.147175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61542a-5c46-4d9e-aba3-cb93d1058f37 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:01.187094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:01.243250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 579/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:42:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:42:01.249150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c60d87-4b6e-4fe0-8581-6d687169fb2c None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:01.348445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c60d87-4b6e-4fe0-8581-6d687169fb2c None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:01.357396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:01.382489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4367-4f77-43bd-952a-c3cf605f18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:01.383107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4367-4f77-43bd-952a-c3cf605f18d1 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:01.383416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4367-4f77-43bd-952a-c3cf605f18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:01.383686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4367-4f77-43bd-952a-c3cf605f18d1 None admin] PATH_INFO: `/v3/projects/77316c7e916643b289916eafca3493d8` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:01.384833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4367-4f77-43bd-952a-c3cf605f18d1 None admin] RBAC: Authorizing `identity:get_project(project_id=77316c7e916643b289916eafca3493d8)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:01.386585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4367-4f77-43bd-952a-c3cf605f18d1 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:01.388498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 566/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:42:01 2022] GET /identity/v3/projects/77316c7e916643b289916eafca3493d8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:01.394981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61542a-5c46-4d9e-aba3-cb93d1058f37 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:01.491970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61542a-5c46-4d9e-aba3-cb93d1058f37 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:01.526021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0871d-2d97-474a-9ad8-25ec5e91e619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:01.526540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0871d-2d97-474a-9ad8-25ec5e91e619 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:01.526814 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0871d-2d97-474a-9ad8-25ec5e91e619 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:01.527080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0871d-2d97-474a-9ad8-25ec5e91e619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:01.527833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0871d-2d97-474a-9ad8-25ec5e91e619 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=77316c7e916643b289916eafca3493d8, user.id=c09242a5766243c4a86dc1cef2741e60) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:01.528133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0871d-2d97-474a-9ad8-25ec5e91e619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:01.529545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0871d-2d97-474a-9ad8-25ec5e91e619 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:01.535468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 580/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:42:01 2022] GET /identity/v3/role_assignments?user.id=c09242a5766243c4a86dc1cef2741e60&scope.project.id=77316c7e916643b289916eafca3493d8&role.id=9ec7f759c0a64655b794dfb597930076 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:03.387215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d1936-82b0-47eb-ae7e-c8a4f404db0d None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:03.387765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d1936-82b0-47eb-ae7e-c8a4f404db0d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:03.387765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d1936-82b0-47eb-ae7e-c8a4f404db0d None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:03.389114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 567/1147] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:03.395364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd59c-9169-45c6-b5b4-cba6e70cb031 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:03.395881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd59c-9169-45c6-b5b4-cba6e70cb031 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:03.395881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd59c-9169-45c6-b5b4-cba6e70cb031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:03.409795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:03.415556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-2ecfd59c-9169-45c6-b5b4-cba6e70cb031 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:03.416519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2ecfd59c-9169-45c6-b5b4-cba6e70cb031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:03.487270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 581/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:42:03.759932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d1936-82b0-47eb-ae7e-c8a4f404db0d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:03.860306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d1936-82b0-47eb-ae7e-c8a4f404db0d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:03.894127 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1e9b-86c9-489e-9173-bbbe6a64c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:03.894747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1e9b-86c9-489e-9173-bbbe6a64c891 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:03.895081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1e9b-86c9-489e-9173-bbbe6a64c891 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:03.895532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e1e9b-86c9-489e-9173-bbbe6a64c891 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:03.905459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e1e9b-86c9-489e-9173-bbbe6a64c891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-5f1e1e9b-86c9-489e-9173-bbbe6a64c891 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:42:03.910833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:42:03.911853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:42:03.912734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 568/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:42:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:42:03.918160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd59c-9169-45c6-b5b4-cba6e70cb031 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:04.015105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd59c-9169-45c6-b5b4-cba6e70cb031 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:04.049001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c820b-d191-4644-892b-122d1d89aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:04.049597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c820b-d191-4644-892b-122d1d89aa21 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:04.049873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c820b-d191-4644-892b-122d1d89aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:04.050141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c820b-d191-4644-892b-122d1d89aa21 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:04.050802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c820b-d191-4644-892b-122d1d89aa21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:04.051102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c820b-d191-4644-892b-122d1d89aa21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:04.052500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c820b-d191-4644-892b-122d1d89aa21 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:04.054672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:04.060763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 582/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:04.066785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1e9b-86c9-489e-9173-bbbe6a64c891 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:04.103609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:04.168009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e1e9b-86c9-489e-9173-bbbe6a64c891 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:04.200937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd19df-b5b5-4b5d-b224-3f0c8b116496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:04.201552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd19df-b5b5-4b5d-b224-3f0c8b116496 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:04.201831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd19df-b5b5-4b5d-b224-3f0c8b116496 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:04.202103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd19df-b5b5-4b5d-b224-3f0c8b116496 None admin] PATH_INFO: `/v3/users/c09242a5766243c4a86dc1cef2741e60` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:04.203217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd19df-b5b5-4b5d-b224-3f0c8b116496 None admin] RBAC: Authorizing `identity:get_user(user_id=c09242a5766243c4a86dc1cef2741e60)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:04.205189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd19df-b5b5-4b5d-b224-3f0c8b116496 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:04.206765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 569/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:42:04 2022] GET /identity/v3/users/c09242a5766243c4a86dc1cef2741e60 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:04.212542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c820b-d191-4644-892b-122d1d89aa21 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:04.310852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c820b-d191-4644-892b-122d1d89aa21 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:04.344298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef4518-57f1-4e88-8f71-a8a67ac80dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:04.345010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef4518-57f1-4e88-8f71-a8a67ac80dc7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:04.345289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef4518-57f1-4e88-8f71-a8a67ac80dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:04.345560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef4518-57f1-4e88-8f71-a8a67ac80dc7 None admin] PATH_INFO: `/v3/projects/77316c7e916643b289916eafca3493d8` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:04.346670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef4518-57f1-4e88-8f71-a8a67ac80dc7 None admin] RBAC: Authorizing `identity:get_project(project_id=77316c7e916643b289916eafca3493d8)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:04.348132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef4518-57f1-4e88-8f71-a8a67ac80dc7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:04.349755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 583/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:42:04 2022] GET /identity/v3/projects/77316c7e916643b289916eafca3493d8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:04.355701 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd19df-b5b5-4b5d-b224-3f0c8b116496 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:04.454613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd19df-b5b5-4b5d-b224-3f0c8b116496 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:04.457050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:04.487712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b8bb7-2102-44ff-a75c-53d231acf14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:04.488388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b8bb7-2102-44ff-a75c-53d231acf14a None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:04.489025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b8bb7-2102-44ff-a75c-53d231acf14a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:04.489489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b8bb7-2102-44ff-a75c-53d231acf14a None admin] PATH_INFO: `/v3/projects/77316c7e916643b289916eafca3493d8/users/c09242a5766243c4a86dc1cef2741e60/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:04.491696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b8bb7-2102-44ff-a75c-53d231acf14a None admin] RBAC: Authorizing `identity:create_grant(project_id=77316c7e916643b289916eafca3493d8, user_id=c09242a5766243c4a86dc1cef2741e60, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:04.493130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b8bb7-2102-44ff-a75c-53d231acf14a None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:04.563371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 570/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:42:04 2022] PUT /identity/v3/projects/77316c7e916643b289916eafca3493d8/users/c09242a5766243c4a86dc1cef2741e60/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:42:06.441912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a48a9-f7bd-4f13-a99a-bae760cff0b7 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:06.442429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a48a9-f7bd-4f13-a99a-bae760cff0b7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:06.442525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a48a9-f7bd-4f13-a99a-bae760cff0b7 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:06.443832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 584/1154] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:06.449027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8400598-9d47-46b6-b67c-538d434db073 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:06.449426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8400598-9d47-46b6-b67c-538d434db073 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:06.449571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8400598-9d47-46b6-b67c-538d434db073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:06.467707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b8400598-9d47-46b6-b67c-538d434db073 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:06.468888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b8400598-9d47-46b6-b67c-538d434db073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:06.535428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 571/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:42:06.805541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a48a9-f7bd-4f13-a99a-bae760cff0b7 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:06.872536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:06.909582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a48a9-f7bd-4f13-a99a-bae760cff0b7 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:06.942831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98e37-1670-4fef-bc85-ac7a49ceb702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:06.943476 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98e37-1670-4fef-bc85-ac7a49ceb702 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:06.943757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98e37-1670-4fef-bc85-ac7a49ceb702 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:06.944030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98e37-1670-4fef-bc85-ac7a49ceb702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:06.954047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98e37-1670-4fef-bc85-ac7a49ceb702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-cac98e37-1670-4fef-bc85-ac7a49ceb702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:42:06.959254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:42:06.960279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:42:06.961529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 585/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:42:06.966376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8400598-9d47-46b6-b67c-538d434db073 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:07.056518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:07.062592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8400598-9d47-46b6-b67c-538d434db073 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:07.096541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6a60-c2c1-4dc0-886e-7764350cdc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:07.097133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6a60-c2c1-4dc0-886e-7764350cdc1e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:07.097405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6a60-c2c1-4dc0-886e-7764350cdc1e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:07.097669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd6a60-c2c1-4dc0-886e-7764350cdc1e None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:07.098325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd6a60-c2c1-4dc0-886e-7764350cdc1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:07.098621 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd6a60-c2c1-4dc0-886e-7764350cdc1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:07.100012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd6a60-c2c1-4dc0-886e-7764350cdc1e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:07.108110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 572/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:07.114609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98e37-1670-4fef-bc85-ac7a49ceb702 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:07.213132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98e37-1670-4fef-bc85-ac7a49ceb702 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:07.237964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:07.246435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1af5-a5c9-46d8-b810-bda661432fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:07.247055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1af5-a5c9-46d8-b810-bda661432fcb None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:07.247364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1af5-a5c9-46d8-b810-bda661432fcb None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:07.247636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a1af5-a5c9-46d8-b810-bda661432fcb None admin] PATH_INFO: `/v3/users/c09242a5766243c4a86dc1cef2741e60` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:07.248743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1af5-a5c9-46d8-b810-bda661432fcb None admin] RBAC: Authorizing `identity:get_user(user_id=c09242a5766243c4a86dc1cef2741e60)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:07.250200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a1af5-a5c9-46d8-b810-bda661432fcb None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:07.252494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 586/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:42:07 2022] GET /identity/v3/users/c09242a5766243c4a86dc1cef2741e60 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:07.258782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6a60-c2c1-4dc0-886e-7764350cdc1e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:07.360557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd6a60-c2c1-4dc0-886e-7764350cdc1e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:07.393314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5d8d1-c265-482a-a09c-e66cc556ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:07.393913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5d8d1-c265-482a-a09c-e66cc556ad93 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:07.394187 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5d8d1-c265-482a-a09c-e66cc556ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:07.394456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5d8d1-c265-482a-a09c-e66cc556ad93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:07.419400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:07.463413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5d8d1-c265-482a-a09c-e66cc556ad93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:07.464855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5d8d1-c265-482a-a09c-e66cc556ad93 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:07.561372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 573/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:42:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:42:07.567962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1af5-a5c9-46d8-b810-bda661432fcb None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:07.667465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a1af5-a5c9-46d8-b810-bda661432fcb None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:07.700321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b473152-a39c-42bc-99b6-cb35f020aeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:07.700941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b473152-a39c-42bc-99b6-cb35f020aeed None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:07.701218 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b473152-a39c-42bc-99b6-cb35f020aeed None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:07.701489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b473152-a39c-42bc-99b6-cb35f020aeed None admin] PATH_INFO: `/v3/projects/77316c7e916643b289916eafca3493d8` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:07.702592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b473152-a39c-42bc-99b6-cb35f020aeed None admin] RBAC: Authorizing `identity:get_project(project_id=77316c7e916643b289916eafca3493d8)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:07.704108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b473152-a39c-42bc-99b6-cb35f020aeed None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:07.705720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 587/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:42:07 2022] GET /identity/v3/projects/77316c7e916643b289916eafca3493d8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:07.711948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5d8d1-c265-482a-a09c-e66cc556ad93 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:07.773684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:07.817366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5d8d1-c265-482a-a09c-e66cc556ad93 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:07.850294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ff344-a594-4aad-8091-a54ea7ce9f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:07.850758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ff344-a594-4aad-8091-a54ea7ce9f91 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:07.851031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ff344-a594-4aad-8091-a54ea7ce9f91 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:07.851340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ff344-a594-4aad-8091-a54ea7ce9f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:07.852034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ff344-a594-4aad-8091-a54ea7ce9f91 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=77316c7e916643b289916eafca3493d8, user.id=c09242a5766243c4a86dc1cef2741e60) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:07.852336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ff344-a594-4aad-8091-a54ea7ce9f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:07.853752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ff344-a594-4aad-8091-a54ea7ce9f91 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:07.860190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 574/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:42:07 2022] GET /identity/v3/role_assignments?user.id=c09242a5766243c4a86dc1cef2741e60&scope.project.id=77316c7e916643b289916eafca3493d8&role.id=9ec7f759c0a64655b794dfb597930076 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:09.767036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be339d-a6af-46fd-b477-db5db5631f17 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:09.767672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be339d-a6af-46fd-b477-db5db5631f17 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:09.767672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be339d-a6af-46fd-b477-db5db5631f17 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:09.768944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 588/1162] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:09.775035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b97219-8ec0-4756-8005-9d00dfe0a912 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:09.775588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b97219-8ec0-4756-8005-9d00dfe0a912 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:09.776060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b97219-8ec0-4756-8005-9d00dfe0a912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:09.798351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-02b97219-8ec0-4756-8005-9d00dfe0a912 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:09.799563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-02b97219-8ec0-4756-8005-9d00dfe0a912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:09.868373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 575/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:42:10.141338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be339d-a6af-46fd-b477-db5db5631f17 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:10.203313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:10.242989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be339d-a6af-46fd-b477-db5db5631f17 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:10.276877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b93834-b50f-4a96-afc8-40087698f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:10.277484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93834-b50f-4a96-afc8-40087698f3b0 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:10.277765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93834-b50f-4a96-afc8-40087698f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:10.278039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93834-b50f-4a96-afc8-40087698f3b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:10.343772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b93834-b50f-4a96-afc8-40087698f3b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:10.345822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b93834-b50f-4a96-afc8-40087698f3b0 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:10.404068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:10.444094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 589/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:42:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:42:10.450031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b97219-8ec0-4756-8005-9d00dfe0a912 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:10.498799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:10.547769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b97219-8ec0-4756-8005-9d00dfe0a912 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:10.580520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681775a-34cb-45ed-85d4-19f296144bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:10.581138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681775a-34cb-45ed-85d4-19f296144bb3 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:10.581415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681775a-34cb-45ed-85d4-19f296144bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:10.581687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681775a-34cb-45ed-85d4-19f296144bb3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:10.588184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681775a-34cb-45ed-85d4-19f296144bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:10.589619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681775a-34cb-45ed-85d4-19f296144bb3 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-1681775a-34cb-45ed-85d4-19f296144bb3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:42:10.601224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:42:10.602571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:42:10.603761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 576/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:42:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:42:10.608357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b93834-b50f-4a96-afc8-40087698f3b0 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:10.705768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b93834-b50f-4a96-afc8-40087698f3b0 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:10.740816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcc2f3-20e3-4f2e-a2ae-bd40fc07cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:10.741402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcc2f3-20e3-4f2e-a2ae-bd40fc07cc72 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:10.741675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcc2f3-20e3-4f2e-a2ae-bd40fc07cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:10.741942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcc2f3-20e3-4f2e-a2ae-bd40fc07cc72 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:10.742571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcc2f3-20e3-4f2e-a2ae-bd40fc07cc72 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:10.742870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcc2f3-20e3-4f2e-a2ae-bd40fc07cc72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:10.744250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcc2f3-20e3-4f2e-a2ae-bd40fc07cc72 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:10.751135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 590/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Aug 22 19:42:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:12.639812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648746-4fae-4f0e-aeb6-b92b8ec0e759 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:12.640334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648746-4fae-4f0e-aeb6-b92b8ec0e759 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:12.640334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648746-4fae-4f0e-aeb6-b92b8ec0e759 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:12.642321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 577/1167] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:12.647624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690519f-1bb8-4393-8bf1-15e342b64ea9 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:12.648071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690519f-1bb8-4393-8bf1-15e342b64ea9 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:12.648214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690519f-1bb8-4393-8bf1-15e342b64ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:12.665791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7690519f-1bb8-4393-8bf1-15e342b64ea9 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:12.666957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7690519f-1bb8-4393-8bf1-15e342b64ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:12.686437 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:12.734284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 591/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:42:13.005172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648746-4fae-4f0e-aeb6-b92b8ec0e759 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:13.108100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648746-4fae-4f0e-aeb6-b92b8ec0e759 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:13.119215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:13.143576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bdff1-dbba-4fd1-8638-4dd38b23fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:13.144181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bdff1-dbba-4fd1-8638-4dd38b23fc73 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:13.144461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bdff1-dbba-4fd1-8638-4dd38b23fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:13.144740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bdff1-dbba-4fd1-8638-4dd38b23fc73 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:13.145398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bdff1-dbba-4fd1-8638-4dd38b23fc73 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:13.146768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bdff1-dbba-4fd1-8638-4dd38b23fc73 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:13.246843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 578/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Mon Aug 22 19:42:13 2022] POST /identity/v3/domains => generated 267 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:42:15.182879 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102f24a-0626-477b-85f1-667a86823dcc None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:15.183451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102f24a-0626-477b-85f1-667a86823dcc None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:15.183451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102f24a-0626-477b-85f1-667a86823dcc None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:15.184930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 592/1170] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:15.190354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9b8f3-bdb1-4001-860e-48a509006e99 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:15.190744 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9b8f3-bdb1-4001-860e-48a509006e99 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:15.190912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9b8f3-bdb1-4001-860e-48a509006e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:15.209567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4ea9b8f3-bdb1-4001-860e-48a509006e99 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:15.210762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4ea9b8f3-bdb1-4001-860e-48a509006e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:15.276871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 579/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:42:15.545895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102f24a-0626-477b-85f1-667a86823dcc None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:15.649203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102f24a-0626-477b-85f1-667a86823dcc None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:15.683147 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70505a9a-8b9d-41e1-a994-13cd08bdf64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:15.683792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505a9a-8b9d-41e1-a994-13cd08bdf64f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:15.684069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505a9a-8b9d-41e1-a994-13cd08bdf64f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:15.684345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505a9a-8b9d-41e1-a994-13cd08bdf64f None admin] PATH_INFO: `/v3/domains/ee542c22e2d6453cb8088cbe0e6728cc` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:15.696033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70505a9a-8b9d-41e1-a994-13cd08bdf64f None admin] RBAC: Authorizing `identity:get_domain(domain_id=ee542c22e2d6453cb8088cbe0e6728cc)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:15.697477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70505a9a-8b9d-41e1-a994-13cd08bdf64f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:15.699113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 593/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Aug 22 19:42:15 2022] GET /identity/v3/domains/ee542c22e2d6453cb8088cbe0e6728cc => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:15.705465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9b8f3-bdb1-4001-860e-48a509006e99 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:15.802847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:15.805898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9b8f3-bdb1-4001-860e-48a509006e99 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:15.840990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b453c6a-0813-4ce1-a35c-61572940e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:15.841592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b453c6a-0813-4ce1-a35c-61572940e992 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:15.841873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b453c6a-0813-4ce1-a35c-61572940e992 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:15.842175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b453c6a-0813-4ce1-a35c-61572940e992 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:15.842810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b453c6a-0813-4ce1-a35c-61572940e992 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:15.844935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b453c6a-0813-4ce1-a35c-61572940e992 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:15.920948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 580/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:42:15 2022] POST /identity/v3/projects => generated 361 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:42:17.854906 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367a8a-6eb7-4716-a2bb-cbde76ee4e69 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:17.855489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367a8a-6eb7-4716-a2bb-cbde76ee4e69 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:17.855489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367a8a-6eb7-4716-a2bb-cbde76ee4e69 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:17.856834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 594/1174] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:17.862798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d33d00-bdd1-4aff-81bd-52a62b8b03b0 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:17.863206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d33d00-bdd1-4aff-81bd-52a62b8b03b0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:17.863395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d33d00-bdd1-4aff-81bd-52a62b8b03b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:17.881562 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-04d33d00-bdd1-4aff-81bd-52a62b8b03b0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:17.882744 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-04d33d00-bdd1-4aff-81bd-52a62b8b03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:17.948870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 581/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:42:18.223662 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367a8a-6eb7-4716-a2bb-cbde76ee4e69 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:18.242443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:18.324144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367a8a-6eb7-4716-a2bb-cbde76ee4e69 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:18.356946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e619c-5d68-400b-98cb-c8c4ad4e38ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:18.357560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e619c-5d68-400b-98cb-c8c4ad4e38ab None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:18.357838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e619c-5d68-400b-98cb-c8c4ad4e38ab None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:18.358102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e619c-5d68-400b-98cb-c8c4ad4e38ab None admin] PATH_INFO: `/v3/domains/ee542c22e2d6453cb8088cbe0e6728cc` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:18.359197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e619c-5d68-400b-98cb-c8c4ad4e38ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=ee542c22e2d6453cb8088cbe0e6728cc)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:18.361290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e619c-5d68-400b-98cb-c8c4ad4e38ab None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:18.362851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 595/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Aug 22 19:42:18 2022] GET /identity/v3/domains/ee542c22e2d6453cb8088cbe0e6728cc => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:18.368648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d33d00-bdd1-4aff-81bd-52a62b8b03b0 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:18.449135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:18.466346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d33d00-bdd1-4aff-81bd-52a62b8b03b0 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:18.499849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99724b8f-2a32-41c9-ade2-642a9d4ffe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:18.500970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724b8f-2a32-41c9-ade2-642a9d4ffe7c None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:18.501244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724b8f-2a32-41c9-ade2-642a9d4ffe7c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:18.501509 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724b8f-2a32-41c9-ade2-642a9d4ffe7c None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:18.502244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99724b8f-2a32-41c9-ade2-642a9d4ffe7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:18.503960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99724b8f-2a32-41c9-ade2-642a9d4ffe7c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:18.588112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 582/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:42:18 2022] POST /identity/v3/users => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:42:20.518033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2897d9-a378-4e16-9c87-dc7a573d6fa6 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:20.518578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2897d9-a378-4e16-9c87-dc7a573d6fa6 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:20.518578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2897d9-a378-4e16-9c87-dc7a573d6fa6 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:20.519968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 596/1178] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:20.525545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28fafd-1365-49bc-9796-ddb55603ccf5 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:20.525957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28fafd-1365-49bc-9796-ddb55603ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:20.526069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28fafd-1365-49bc-9796-ddb55603ccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:20.543778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-2b28fafd-1365-49bc-9796-ddb55603ccf5 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:20.544956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2b28fafd-1365-49bc-9796-ddb55603ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:20.611352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 583/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:42:20.879825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2897d9-a378-4e16-9c87-dc7a573d6fa6 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:20.963749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:20.980573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2897d9-a378-4e16-9c87-dc7a573d6fa6 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:21.015211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270a3e2-0814-417f-b485-4b7ca2121f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:21.015857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270a3e2-0814-417f-b485-4b7ca2121f91 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:21.016139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270a3e2-0814-417f-b485-4b7ca2121f91 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:21.016401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270a3e2-0814-417f-b485-4b7ca2121f91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:21.026414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270a3e2-0814-417f-b485-4b7ca2121f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-6270a3e2-0814-417f-b485-4b7ca2121f91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:42:21.031129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:42:21.033133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:42:21.034313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 597/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:42:21.038871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28fafd-1365-49bc-9796-ddb55603ccf5 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:21.105038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:21.137974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28fafd-1365-49bc-9796-ddb55603ccf5 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:21.172497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d6567-4ddb-43e7-848a-ac46250fccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:21.173167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d6567-4ddb-43e7-848a-ac46250fccaa None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:21.173443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d6567-4ddb-43e7-848a-ac46250fccaa None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:21.173711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d6567-4ddb-43e7-848a-ac46250fccaa None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:21.174370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d6567-4ddb-43e7-848a-ac46250fccaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:21.174667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d6567-4ddb-43e7-848a-ac46250fccaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:21.176065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d6567-4ddb-43e7-848a-ac46250fccaa None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:21.183912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 584/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:21.189738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270a3e2-0814-417f-b485-4b7ca2121f91 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:21.287560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270a3e2-0814-417f-b485-4b7ca2121f91 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:21.320286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09733c-04b2-4a57-b992-d0d6e8dca38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:21.320897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09733c-04b2-4a57-b992-d0d6e8dca38b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:21.321171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09733c-04b2-4a57-b992-d0d6e8dca38b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:21.321437 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09733c-04b2-4a57-b992-d0d6e8dca38b None admin] PATH_INFO: `/v3/users/9c657cdbf2a34547911346c6287bf62a` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:21.335528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09733c-04b2-4a57-b992-d0d6e8dca38b None admin] RBAC: Authorizing `identity:get_user(user_id=9c657cdbf2a34547911346c6287bf62a)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:21.339007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09733c-04b2-4a57-b992-d0d6e8dca38b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:21.339007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 598/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:42:21 2022] GET /identity/v3/users/9c657cdbf2a34547911346c6287bf62a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:21.344535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d6567-4ddb-43e7-848a-ac46250fccaa None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:21.449667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d6567-4ddb-43e7-848a-ac46250fccaa None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:21.479480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:21.485280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87447011-9fb9-4d35-b743-ea4dcfd3b959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:21.485875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87447011-9fb9-4d35-b743-ea4dcfd3b959 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:21.486904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87447011-9fb9-4d35-b743-ea4dcfd3b959 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:21.487401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87447011-9fb9-4d35-b743-ea4dcfd3b959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:21.554910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87447011-9fb9-4d35-b743-ea4dcfd3b959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:21.556389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87447011-9fb9-4d35-b743-ea4dcfd3b959 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:21.656513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 585/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:42:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:42:21.663305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09733c-04b2-4a57-b992-d0d6e8dca38b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:21.666237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:21.761915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09733c-04b2-4a57-b992-d0d6e8dca38b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:21.794701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910829a-5523-40f2-a14a-5364ddcdab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:21.795343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910829a-5523-40f2-a14a-5364ddcdab60 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:21.795620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910829a-5523-40f2-a14a-5364ddcdab60 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:21.795887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910829a-5523-40f2-a14a-5364ddcdab60 None admin] PATH_INFO: `/v3/projects/e8df4e1c351246c1a064593c257db20c` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:21.796984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910829a-5523-40f2-a14a-5364ddcdab60 None admin] RBAC: Authorizing `identity:get_project(project_id=e8df4e1c351246c1a064593c257db20c)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:21.798428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910829a-5523-40f2-a14a-5364ddcdab60 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:21.800753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 599/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:42:21 2022] GET /identity/v3/projects/e8df4e1c351246c1a064593c257db20c => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:21.806805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87447011-9fb9-4d35-b743-ea4dcfd3b959 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:21.840365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:21.909339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87447011-9fb9-4d35-b743-ea4dcfd3b959 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:21.942636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f0072-3089-4202-816d-17fa6f6c6375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:21.943243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f0072-3089-4202-816d-17fa6f6c6375 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:21.943520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f0072-3089-4202-816d-17fa6f6c6375 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:21.943785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f0072-3089-4202-816d-17fa6f6c6375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:21.944498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f0072-3089-4202-816d-17fa6f6c6375 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=e8df4e1c351246c1a064593c257db20c, user.id=9c657cdbf2a34547911346c6287bf62a) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:21.944798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f0072-3089-4202-816d-17fa6f6c6375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:21.946206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f0072-3089-4202-816d-17fa6f6c6375 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:21.951429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 586/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:42:21 2022] GET /identity/v3/role_assignments?user.id=9c657cdbf2a34547911346c6287bf62a&scope.project.id=e8df4e1c351246c1a064593c257db20c&role.id=9ec7f759c0a64655b794dfb597930076 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:23.873896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a89f60-0e10-4993-ba30-f9756d883d42 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:23.874457 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a89f60-0e10-4993-ba30-f9756d883d42 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:23.874457 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a89f60-0e10-4993-ba30-f9756d883d42 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:23.875792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 600/1186] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:23.881992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec014-3911-4181-b848-d4a81834d831 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:23.882436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec014-3911-4181-b848-d4a81834d831 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:23.882540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec014-3911-4181-b848-d4a81834d831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:23.900960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-72cec014-3911-4181-b848-d4a81834d831 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:23.902142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-72cec014-3911-4181-b848-d4a81834d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:23.966929 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 587/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:42:24.238369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a89f60-0e10-4993-ba30-f9756d883d42 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:24.308693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:24.339735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a89f60-0e10-4993-ba30-f9756d883d42 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:24.372610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d70e9f-81ca-4777-978c-72f08e599884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:24.373220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d70e9f-81ca-4777-978c-72f08e599884 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:24.373495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d70e9f-81ca-4777-978c-72f08e599884 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:24.373763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d70e9f-81ca-4777-978c-72f08e599884 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:24.384881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d70e9f-81ca-4777-978c-72f08e599884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-11d70e9f-81ca-4777-978c-72f08e599884 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:42:24.389605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:42:24.390668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:42:24.391739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 601/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:42:24.396927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec014-3911-4181-b848-d4a81834d831 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:24.421871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:24.497451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec014-3911-4181-b848-d4a81834d831 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:24.530112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ef325-df37-440a-b3ee-b0808f0f7c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:24.530703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ef325-df37-440a-b3ee-b0808f0f7c30 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:24.530975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ef325-df37-440a-b3ee-b0808f0f7c30 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:24.531268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ef325-df37-440a-b3ee-b0808f0f7c30 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:24.531932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ef325-df37-440a-b3ee-b0808f0f7c30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:24.532227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ef325-df37-440a-b3ee-b0808f0f7c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:24.534104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ef325-df37-440a-b3ee-b0808f0f7c30 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:24.541869 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 588/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:24.547731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d70e9f-81ca-4777-978c-72f08e599884 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:24.652999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d70e9f-81ca-4777-978c-72f08e599884 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:24.681393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:24.686893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0636c-34e8-4ed6-887a-4391f8f15fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:24.687535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0636c-34e8-4ed6-887a-4391f8f15fa0 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:24.687809 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0636c-34e8-4ed6-887a-4391f8f15fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:24.688123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0636c-34e8-4ed6-887a-4391f8f15fa0 None admin] PATH_INFO: `/v3/users/9c657cdbf2a34547911346c6287bf62a` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:24.689265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0636c-34e8-4ed6-887a-4391f8f15fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=9c657cdbf2a34547911346c6287bf62a)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:24.690674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0636c-34e8-4ed6-887a-4391f8f15fa0 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:24.692271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 602/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:42:24 2022] GET /identity/v3/users/9c657cdbf2a34547911346c6287bf62a => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:24.698016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ef325-df37-440a-b3ee-b0808f0f7c30 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:24.782773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:24.797850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ef325-df37-440a-b3ee-b0808f0f7c30 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:24.830920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d656-cbf5-4ce0-9ad7-d5ef1c3b4afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:24.831566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d656-cbf5-4ce0-9ad7-d5ef1c3b4afa None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:24.831871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d656-cbf5-4ce0-9ad7-d5ef1c3b4afa None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:24.832111 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d656-cbf5-4ce0-9ad7-d5ef1c3b4afa None admin] PATH_INFO: `/v3/projects/e8df4e1c351246c1a064593c257db20c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:24.833218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7d656-cbf5-4ce0-9ad7-d5ef1c3b4afa None admin] RBAC: Authorizing `identity:get_project(project_id=e8df4e1c351246c1a064593c257db20c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:24.834642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7d656-cbf5-4ce0-9ad7-d5ef1c3b4afa None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:24.836308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 589/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:42:24 2022] GET /identity/v3/projects/e8df4e1c351246c1a064593c257db20c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:24.842380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0636c-34e8-4ed6-887a-4391f8f15fa0 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:24.941207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0636c-34e8-4ed6-887a-4391f8f15fa0 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:24.974257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5182f-28d4-4cc6-94a1-d5d4d5a47177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:24.974888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5182f-28d4-4cc6-94a1-d5d4d5a47177 None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:24.975164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5182f-28d4-4cc6-94a1-d5d4d5a47177 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:24.975465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5182f-28d4-4cc6-94a1-d5d4d5a47177 None admin] PATH_INFO: `/v3/projects/e8df4e1c351246c1a064593c257db20c/users/9c657cdbf2a34547911346c6287bf62a/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:24.977327 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5182f-28d4-4cc6-94a1-d5d4d5a47177 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8df4e1c351246c1a064593c257db20c, user_id=9c657cdbf2a34547911346c6287bf62a, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:24.978755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5182f-28d4-4cc6-94a1-d5d4d5a47177 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:25.049631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 603/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:42:24 2022] PUT /identity/v3/projects/e8df4e1c351246c1a064593c257db20c/users/9c657cdbf2a34547911346c6287bf62a/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:42:26.918471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936c5a2-5327-40ea-b6ff-fd48b8a56e2e None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:26.919041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936c5a2-5327-40ea-b6ff-fd48b8a56e2e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:26.919041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936c5a2-5327-40ea-b6ff-fd48b8a56e2e None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:26.920388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 590/1193] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:42:26.925910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d5cc0-d9d7-4b79-b55f-d4b704e51ae7 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:26.926330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d5cc0-d9d7-4b79-b55f-d4b704e51ae7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:26.926448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d5cc0-d9d7-4b79-b55f-d4b704e51ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:26.944707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-467d5cc0-d9d7-4b79-b55f-d4b704e51ae7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:42:26.945903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-467d5cc0-d9d7-4b79-b55f-d4b704e51ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:42:26.999447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:27.013675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 604/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:42:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:42:27.281626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936c5a2-5327-40ea-b6ff-fd48b8a56e2e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:27.383131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936c5a2-5327-40ea-b6ff-fd48b8a56e2e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:27.417124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af6b58-003c-422f-9934-347581dd8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:27.417751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af6b58-003c-422f-9934-347581dd8d5a None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:27.418028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af6b58-003c-422f-9934-347581dd8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:27.418295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af6b58-003c-422f-9934-347581dd8d5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:27.428884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af6b58-003c-422f-9934-347581dd8d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-b5af6b58-003c-422f-9934-347581dd8d5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:42:27.433648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:42:27.434755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:42:27.436021 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 591/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:42:27.441479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d5cc0-d9d7-4b79-b55f-d4b704e51ae7 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:27.537866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d5cc0-d9d7-4b79-b55f-d4b704e51ae7 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:27.571505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7e804-fe96-41a4-aeba-e2fc0154152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:27.572091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7e804-fe96-41a4-aeba-e2fc0154152c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:27.572362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7e804-fe96-41a4-aeba-e2fc0154152c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:27.572628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7e804-fe96-41a4-aeba-e2fc0154152c None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:27.573282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7e804-fe96-41a4-aeba-e2fc0154152c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:27.573574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7e804-fe96-41a4-aeba-e2fc0154152c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:27.574926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7e804-fe96-41a4-aeba-e2fc0154152c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:27.582739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 605/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:27.588519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af6b58-003c-422f-9934-347581dd8d5a None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:27.605098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:27.687693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af6b58-003c-422f-9934-347581dd8d5a None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:27.721029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126a9ba-ba30-461e-9339-8f018df54ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:27.721626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a9ba-ba30-461e-9339-8f018df54ba8 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:27.721899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a9ba-ba30-461e-9339-8f018df54ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:27.722165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126a9ba-ba30-461e-9339-8f018df54ba8 None admin] PATH_INFO: `/v3/users/9c657cdbf2a34547911346c6287bf62a` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:27.723297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126a9ba-ba30-461e-9339-8f018df54ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=9c657cdbf2a34547911346c6287bf62a)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:27.724722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126a9ba-ba30-461e-9339-8f018df54ba8 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:27.726275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 592/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Aug 22 19:42:27 2022] GET /identity/v3/users/9c657cdbf2a34547911346c6287bf62a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:27.732201 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7e804-fe96-41a4-aeba-e2fc0154152c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:27.781709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:27.831311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7e804-fe96-41a4-aeba-e2fc0154152c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:27.864351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f4e8-5b5e-4c48-9847-7ee7874d3b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:27.864950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f4e8-5b5e-4c48-9847-7ee7874d3b90 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:27.865223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f4e8-5b5e-4c48-9847-7ee7874d3b90 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:27.865489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f4e8-5b5e-4c48-9847-7ee7874d3b90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:27.932122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806f4e8-5b5e-4c48-9847-7ee7874d3b90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:27.933566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806f4e8-5b5e-4c48-9847-7ee7874d3b90 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:27.979946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:28.030406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 606/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:42:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:42:28.036627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126a9ba-ba30-461e-9339-8f018df54ba8 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:28.116914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:28.135725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126a9ba-ba30-461e-9339-8f018df54ba8 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:28.169045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c08f8-c179-4cad-b817-1b91a5c23407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:28.169657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c08f8-c179-4cad-b817-1b91a5c23407 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:28.169933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c08f8-c179-4cad-b817-1b91a5c23407 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:28.170200 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c08f8-c179-4cad-b817-1b91a5c23407 None admin] PATH_INFO: `/v3/projects/e8df4e1c351246c1a064593c257db20c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:28.171339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c08f8-c179-4cad-b817-1b91a5c23407 None admin] RBAC: Authorizing `identity:get_project(project_id=e8df4e1c351246c1a064593c257db20c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:28.172833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c08f8-c179-4cad-b817-1b91a5c23407 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:28.175207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 593/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Aug 22 19:42:28 2022] GET /identity/v3/projects/e8df4e1c351246c1a064593c257db20c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:42:28.181469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f4e8-5b5e-4c48-9847-7ee7874d3b90 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:42:28.277523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f4e8-5b5e-4c48-9847-7ee7874d3b90 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:42:28.311629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdab4c-9f5d-4468-b027-5ef4124ec6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:42:28.312225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdab4c-9f5d-4468-b027-5ef4124ec6e6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:42:28.312500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdab4c-9f5d-4468-b027-5ef4124ec6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:42:28.312768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdab4c-9f5d-4468-b027-5ef4124ec6e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:42:28.313480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdab4c-9f5d-4468-b027-5ef4124ec6e6 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=e8df4e1c351246c1a064593c257db20c, user.id=9c657cdbf2a34547911346c6287bf62a) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:42:28.313783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdab4c-9f5d-4468-b027-5ef4124ec6e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:42:28.315251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdab4c-9f5d-4468-b027-5ef4124ec6e6 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:42:28.320950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 607/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:42:28 2022] GET /identity/v3/role_assignments?user.id=9c657cdbf2a34547911346c6287bf62a&scope.project.id=e8df4e1c351246c1a064593c257db20c&role.id=9ec7f759c0a64655b794dfb597930076 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:42:38.164965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=25 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:42:38.318304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=93 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:41.549503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab1d6-6df6-423e-8df4-eeb3d69032cd None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:41.550091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab1d6-6df6-423e-8df4-eeb3d69032cd None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:41.550091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dab1d6-6df6-423e-8df4-eeb3d69032cd None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:41.551476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 594/1201] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:43:41.556668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c87577-a06b-4f6b-afc6-9ad35cc8b941 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:41.557123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c87577-a06b-4f6b-afc6-9ad35cc8b941 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:41.557234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c87577-a06b-4f6b-afc6-9ad35cc8b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:41.575687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-62c87577-a06b-4f6b-afc6-9ad35cc8b941 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:43:41.576876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-62c87577-a06b-4f6b-afc6-9ad35cc8b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:43:41.642450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 608/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:43:41.912015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dab1d6-6df6-423e-8df4-eeb3d69032cd None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:42.013461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dab1d6-6df6-423e-8df4-eeb3d69032cd None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:42.047435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224b26b-1303-4d7f-8ee9-c6a71f89e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:42.048044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224b26b-1303-4d7f-8ee9-c6a71f89e61b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:42.048316 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224b26b-1303-4d7f-8ee9-c6a71f89e61b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:42.048599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224b26b-1303-4d7f-8ee9-c6a71f89e61b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:42.058771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224b26b-1303-4d7f-8ee9-c6a71f89e61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:42.060232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224b26b-1303-4d7f-8ee9-c6a71f89e61b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-c224b26b-1303-4d7f-8ee9-c6a71f89e61b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:43:42.077778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:42.079516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:43:42.080693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:43:42.080693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:42.080693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:43:42.080693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 595/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:42.085038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c87577-a06b-4f6b-afc6-9ad35cc8b941 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:42.185115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c87577-a06b-4f6b-afc6-9ad35cc8b941 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:42.212974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:42.219208 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1203f-105b-4b3e-8a4a-2d5afb9b66d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:42.219841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1203f-105b-4b3e-8a4a-2d5afb9b66d3 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:42.220118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1203f-105b-4b3e-8a4a-2d5afb9b66d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:42.220388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1203f-105b-4b3e-8a4a-2d5afb9b66d3 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:42.221027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1203f-105b-4b3e-8a4a-2d5afb9b66d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:42.221324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1203f-105b-4b3e-8a4a-2d5afb9b66d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:42.222719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1203f-105b-4b3e-8a4a-2d5afb9b66d3 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:42.234515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 609/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:42.240519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224b26b-1303-4d7f-8ee9-c6a71f89e61b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:42.294892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:42.340651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224b26b-1303-4d7f-8ee9-c6a71f89e61b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:42.379493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f479551-cd39-4557-a49f-89a2e425cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:42.380088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f479551-cd39-4557-a49f-89a2e425cceb None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:42.380361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f479551-cd39-4557-a49f-89a2e425cceb None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:42.380623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f479551-cd39-4557-a49f-89a2e425cceb None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:42.381251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f479551-cd39-4557-a49f-89a2e425cceb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:42.382686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f479551-cd39-4557-a49f-89a2e425cceb None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:42.495530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 596/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Aug 22 19:43:42 2022] POST /identity/v3/users => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:43:44.425890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc172f-81a2-4bf5-b2d9-af9863fc50f5 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:44.426418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc172f-81a2-4bf5-b2d9-af9863fc50f5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:44.426418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc172f-81a2-4bf5-b2d9-af9863fc50f5 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:44.427895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 610/1206] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:43:44.433915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7162d85-48dd-4087-9cbc-3cb1ae31e163 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:44.434317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7162d85-48dd-4087-9cbc-3cb1ae31e163 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:44.434463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7162d85-48dd-4087-9cbc-3cb1ae31e163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:44.453525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b7162d85-48dd-4087-9cbc-3cb1ae31e163 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:43:44.454718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b7162d85-48dd-4087-9cbc-3cb1ae31e163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:43:44.524380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 597/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:43:44.797741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc172f-81a2-4bf5-b2d9-af9863fc50f5 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:44.902024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc172f-81a2-4bf5-b2d9-af9863fc50f5 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:44.935710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a829c-b0fe-4710-8f57-bfb558985e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:44.936332 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a829c-b0fe-4710-8f57-bfb558985e2b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:44.936607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a829c-b0fe-4710-8f57-bfb558985e2b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:44.936874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a829c-b0fe-4710-8f57-bfb558985e2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:44.946752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a829c-b0fe-4710-8f57-bfb558985e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-733a829c-b0fe-4710-8f57-bfb558985e2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:43:44.952177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:44.958331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:44.959176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 611/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:43:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:44.959935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7162d85-48dd-4087-9cbc-3cb1ae31e163 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:44.999038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:45.058792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7162d85-48dd-4087-9cbc-3cb1ae31e163 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:45.093099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44521e95-f818-48b3-873f-ebd41e380989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:45.093698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44521e95-f818-48b3-873f-ebd41e380989 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:45.093974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44521e95-f818-48b3-873f-ebd41e380989 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:45.094244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44521e95-f818-48b3-873f-ebd41e380989 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:45.094901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44521e95-f818-48b3-873f-ebd41e380989 None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:45.095206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44521e95-f818-48b3-873f-ebd41e380989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:45.096600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44521e95-f818-48b3-873f-ebd41e380989 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:45.105468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 598/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:43:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:45.111284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a829c-b0fe-4710-8f57-bfb558985e2b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:45.162361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:45.211644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a829c-b0fe-4710-8f57-bfb558985e2b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:45.246517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc257b-c11f-4925-9f53-d0cbf98c354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:45.247254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc257b-c11f-4925-9f53-d0cbf98c354f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:45.247540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc257b-c11f-4925-9f53-d0cbf98c354f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:45.247810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc257b-c11f-4925-9f53-d0cbf98c354f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:45.257911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc257b-c11f-4925-9f53-d0cbf98c354f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:45.259388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc257b-c11f-4925-9f53-d0cbf98c354f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-9bdc257b-c11f-4925-9f53-d0cbf98c354f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:43:45.274203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:45.275329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:43:45.277142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:43:45.277142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:45.277142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:45.277142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 612/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:45.281850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44521e95-f818-48b3-873f-ebd41e380989 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:45.378773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:45.382018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44521e95-f818-48b3-873f-ebd41e380989 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:45.416502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9fbc2-963f-4bf1-a3af-97f6de9b8c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:45.417159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9fbc2-963f-4bf1-a3af-97f6de9b8c7f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:45.417430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9fbc2-963f-4bf1-a3af-97f6de9b8c7f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:45.417699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9fbc2-963f-4bf1-a3af-97f6de9b8c7f None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:45.418336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9fbc2-963f-4bf1-a3af-97f6de9b8c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:45.418634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9fbc2-963f-4bf1-a3af-97f6de9b8c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:45.420027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9fbc2-963f-4bf1-a3af-97f6de9b8c7f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:45.431101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 599/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:45.436968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc257b-c11f-4925-9f53-d0cbf98c354f None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:45.538607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc257b-c11f-4925-9f53-d0cbf98c354f None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:45.540221 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:45.574851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42e70e-5aa3-4253-a115-084ec39182fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:45.575553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e70e-5aa3-4253-a115-084ec39182fb None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:45.575830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e70e-5aa3-4253-a115-084ec39182fb None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:45.576097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42e70e-5aa3-4253-a115-084ec39182fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:45.582918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42e70e-5aa3-4253-a115-084ec39182fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:45.584368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42e70e-5aa3-4253-a115-084ec39182fb None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-5d42e70e-5aa3-4253-a115-084ec39182fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:43:45.595663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:45.596776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:45.597782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 613/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:45.602625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9fbc2-963f-4bf1-a3af-97f6de9b8c7f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:45.702732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9fbc2-963f-4bf1-a3af-97f6de9b8c7f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:45.737299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871628e3-9dec-46e9-a586-cd9b4fcce192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:45.737902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871628e3-9dec-46e9-a586-cd9b4fcce192 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:45.738184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871628e3-9dec-46e9-a586-cd9b4fcce192 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:45.738460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871628e3-9dec-46e9-a586-cd9b4fcce192 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:45.739190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871628e3-9dec-46e9-a586-cd9b4fcce192 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:45.739530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871628e3-9dec-46e9-a586-cd9b4fcce192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:45.740976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871628e3-9dec-46e9-a586-cd9b4fcce192 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:45.759914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 600/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 19:43:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:43:45.766308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42e70e-5aa3-4253-a115-084ec39182fb None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:45.864966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42e70e-5aa3-4253-a115-084ec39182fb None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:45.899070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893f62d-a26e-4f31-bf78-6b7b4f76936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:45.899689 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893f62d-a26e-4f31-bf78-6b7b4f76936a None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:45.899963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893f62d-a26e-4f31-bf78-6b7b4f76936a None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:45.900229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893f62d-a26e-4f31-bf78-6b7b4f76936a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:45.929907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:45.966934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893f62d-a26e-4f31-bf78-6b7b4f76936a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:45.968339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893f62d-a26e-4f31-bf78-6b7b4f76936a None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:46.065652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 614/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:43:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:43:46.071592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871628e3-9dec-46e9-a586-cd9b4fcce192 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:46.091886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:46.173535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871628e3-9dec-46e9-a586-cd9b4fcce192 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:46.207385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481967-9330-49c6-af55-6edcd980c480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:46.208007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481967-9330-49c6-af55-6edcd980c480 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:46.208283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481967-9330-49c6-af55-6edcd980c480 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:46.208549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481967-9330-49c6-af55-6edcd980c480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:46.224294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad481967-9330-49c6-af55-6edcd980c480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:46.224294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad481967-9330-49c6-af55-6edcd980c480 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-ad481967-9330-49c6-af55-6edcd980c480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:43:46.235991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:46.237169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:43:46.238271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:43:46.238271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:46.238271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:43:46.238271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 601/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:46.242969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893f62d-a26e-4f31-bf78-6b7b4f76936a None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:46.312938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:46.349887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893f62d-a26e-4f31-bf78-6b7b4f76936a None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:46.383068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92156dec-5a48-4bf2-92f9-66fda9cab9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:46.383829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156dec-5a48-4bf2-92f9-66fda9cab9c3 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:46.384106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156dec-5a48-4bf2-92f9-66fda9cab9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:46.384375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92156dec-5a48-4bf2-92f9-66fda9cab9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:46.385013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92156dec-5a48-4bf2-92f9-66fda9cab9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:46.385311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92156dec-5a48-4bf2-92f9-66fda9cab9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:46.386890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92156dec-5a48-4bf2-92f9-66fda9cab9c3 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:46.398522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 615/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:46.404814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481967-9330-49c6-af55-6edcd980c480 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:46.475531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:46.507570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481967-9330-49c6-af55-6edcd980c480 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:46.545034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e885f-3078-41e2-89d8-1b7f8ca2d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:46.545659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e885f-3078-41e2-89d8-1b7f8ca2d5dd None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:46.545937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e885f-3078-41e2-89d8-1b7f8ca2d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:46.546206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e885f-3078-41e2-89d8-1b7f8ca2d5dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:46.553443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e885f-3078-41e2-89d8-1b7f8ca2d5dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:46.554884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e885f-3078-41e2-89d8-1b7f8ca2d5dd None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-c85e885f-3078-41e2-89d8-1b7f8ca2d5dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:43:46.566235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:46.575315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:46.576439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:43:46.576439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:43:46.576439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:43:46.576439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:43:46.576439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:43:46.576439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:43:46.576439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:43:46.576439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:43:46.576439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 602/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:46.577099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92156dec-5a48-4bf2-92f9-66fda9cab9c3 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:46.674392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92156dec-5a48-4bf2-92f9-66fda9cab9c3 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:46.696557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:46.707918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fada0-c778-48f0-844e-4e17a567c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:46.708517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fada0-c778-48f0-844e-4e17a567c579 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:46.708794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fada0-c778-48f0-844e-4e17a567c579 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:46.709062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fada0-c778-48f0-844e-4e17a567c579 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:46.709748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fada0-c778-48f0-844e-4e17a567c579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:46.710052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fada0-c778-48f0-844e-4e17a567c579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:46.711509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fada0-c778-48f0-844e-4e17a567c579 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:46.723397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 616/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:46.730430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e885f-3078-41e2-89d8-1b7f8ca2d5dd None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:46.830526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e885f-3078-41e2-89d8-1b7f8ca2d5dd None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:46.860099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:46.866007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348473f-9fef-440f-864c-b79dea1ba691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:46.866611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348473f-9fef-440f-864c-b79dea1ba691 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:46.866891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348473f-9fef-440f-864c-b79dea1ba691 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:46.867262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348473f-9fef-440f-864c-b79dea1ba691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:46.868000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348473f-9fef-440f-864c-b79dea1ba691 None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1ef51739456e4beb9ae0f107b13d55f5) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:46.868310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348473f-9fef-440f-864c-b79dea1ba691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:46.869738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348473f-9fef-440f-864c-b79dea1ba691 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:46.875395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 603/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:43:46 2022] GET /identity/v3/role_assignments?user.id=1ef51739456e4beb9ae0f107b13d55f5&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:48.750270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637cbd3-1ca0-400c-9a3d-215621c96ed5 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:48.750848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637cbd3-1ca0-400c-9a3d-215621c96ed5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:48.750848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637cbd3-1ca0-400c-9a3d-215621c96ed5 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:48.752240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 617/1220] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:43:48.758076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f58535-1695-4046-91c0-6b9158222664 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:48.758503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f58535-1695-4046-91c0-6b9158222664 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:48.758669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f58535-1695-4046-91c0-6b9158222664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:48.777784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b5f58535-1695-4046-91c0-6b9158222664 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:43:48.778975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b5f58535-1695-4046-91c0-6b9158222664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:43:48.845279 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 604/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:43:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:43:49.114353 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637cbd3-1ca0-400c-9a3d-215621c96ed5 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:49.217709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637cbd3-1ca0-400c-9a3d-215621c96ed5 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:49.251978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d5ab-8839-46d4-b87e-37af0038c638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:49.252601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d5ab-8839-46d4-b87e-37af0038c638 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:49.252877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d5ab-8839-46d4-b87e-37af0038c638 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:49.253148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d5ab-8839-46d4-b87e-37af0038c638 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:49.263314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723d5ab-8839-46d4-b87e-37af0038c638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-4723d5ab-8839-46d4-b87e-37af0038c638 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:43:49.267987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:49.273499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:49.274433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 618/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:49.275391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f58535-1695-4046-91c0-6b9158222664 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:49.374541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f58535-1695-4046-91c0-6b9158222664 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:49.398753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:49.409942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769bc9a-5b47-411e-bdfe-c16113baa360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:49.410546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769bc9a-5b47-411e-bdfe-c16113baa360 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:49.410823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769bc9a-5b47-411e-bdfe-c16113baa360 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:49.411096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769bc9a-5b47-411e-bdfe-c16113baa360 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:49.411801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769bc9a-5b47-411e-bdfe-c16113baa360 None admin] RBAC: Adding query filter params (name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:49.412104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769bc9a-5b47-411e-bdfe-c16113baa360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:49.413474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769bc9a-5b47-411e-bdfe-c16113baa360 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:49.422356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 605/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:43:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:49.428210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d5ab-8839-46d4-b87e-37af0038c638 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:49.473720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:49.530746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d5ab-8839-46d4-b87e-37af0038c638 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:49.566659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb132ff-5b25-4c8a-af0a-850107a8b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:49.567322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb132ff-5b25-4c8a-af0a-850107a8b891 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:49.567607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb132ff-5b25-4c8a-af0a-850107a8b891 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:49.568171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb132ff-5b25-4c8a-af0a-850107a8b891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:49.579438 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb132ff-5b25-4c8a-af0a-850107a8b891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:49.580981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb132ff-5b25-4c8a-af0a-850107a8b891 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-9cb132ff-5b25-4c8a-af0a-850107a8b891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:43:49.595261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:49.596228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:43:49.597192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:43:49.597192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:49.597192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:49.597192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 619/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:49.602233 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769bc9a-5b47-411e-bdfe-c16113baa360 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:49.702637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769bc9a-5b47-411e-bdfe-c16113baa360 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:49.736800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df864f5-e737-4afa-ac44-ffc779cb2d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:49.737944 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df864f5-e737-4afa-ac44-ffc779cb2d3e None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:49.737944 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df864f5-e737-4afa-ac44-ffc779cb2d3e None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:49.737944 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df864f5-e737-4afa-ac44-ffc779cb2d3e None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:49.738619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df864f5-e737-4afa-ac44-ffc779cb2d3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:49.738922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df864f5-e737-4afa-ac44-ffc779cb2d3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:49.740330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df864f5-e737-4afa-ac44-ffc779cb2d3e None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:49.752219 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 606/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:49.758493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb132ff-5b25-4c8a-af0a-850107a8b891 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:49.851874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:49.858308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb132ff-5b25-4c8a-af0a-850107a8b891 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:49.891573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec1aa-73b4-423c-bdab-ac6e96567d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:49.892186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec1aa-73b4-423c-bdab-ac6e96567d73 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:49.892462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec1aa-73b4-423c-bdab-ac6e96567d73 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:49.892734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec1aa-73b4-423c-bdab-ac6e96567d73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:49.899492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ec1aa-73b4-423c-bdab-ac6e96567d73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:49.900922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ec1aa-73b4-423c-bdab-ac6e96567d73 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-f76ec1aa-73b4-423c-bdab-ac6e96567d73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:43:49.912707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:49.913791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:49.914913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 620/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:49.919763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df864f5-e737-4afa-ac44-ffc779cb2d3e None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:49.969357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:50.020009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df864f5-e737-4afa-ac44-ffc779cb2d3e None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:50.053217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36390-447d-4871-9b79-7f9e35017718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:50.053827 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36390-447d-4871-9b79-7f9e35017718 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:50.054174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36390-447d-4871-9b79-7f9e35017718 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:50.054450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36390-447d-4871-9b79-7f9e35017718 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:50.055172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b36390-447d-4871-9b79-7f9e35017718 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:50.055575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b36390-447d-4871-9b79-7f9e35017718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:50.071691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b36390-447d-4871-9b79-7f9e35017718 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:50.075008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 607/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 19:43:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:50.080709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec1aa-73b4-423c-bdab-ac6e96567d73 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:50.181514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec1aa-73b4-423c-bdab-ac6e96567d73 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:50.215439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0f51a-0f7e-41e3-af1f-6b6a8cc2db96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:50.216083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0f51a-0f7e-41e3-af1f-6b6a8cc2db96 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:50.216362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0f51a-0f7e-41e3-af1f-6b6a8cc2db96 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:50.216633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0f51a-0f7e-41e3-af1f-6b6a8cc2db96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:50.232734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0f51a-0f7e-41e3-af1f-6b6a8cc2db96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:50.234505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0f51a-0f7e-41e3-af1f-6b6a8cc2db96 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-4ce0f51a-0f7e-41e3-af1f-6b6a8cc2db96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:43:50.250057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:50.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:43:50.252285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:43:50.252285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:50.252285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:50.252285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 621/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:50.257742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36390-447d-4871-9b79-7f9e35017718 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:50.365053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36390-447d-4871-9b79-7f9e35017718 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:50.367414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:50.400112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aa363-a47a-4e40-8ee0-f96c1dd03240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:50.400709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aa363-a47a-4e40-8ee0-f96c1dd03240 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:50.400984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aa363-a47a-4e40-8ee0-f96c1dd03240 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:50.401790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aa363-a47a-4e40-8ee0-f96c1dd03240 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:50.402483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aa363-a47a-4e40-8ee0-f96c1dd03240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:50.402780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aa363-a47a-4e40-8ee0-f96c1dd03240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:50.404302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aa363-a47a-4e40-8ee0-f96c1dd03240 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:50.416146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 608/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:50.422844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0f51a-0f7e-41e3-af1f-6b6a8cc2db96 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:50.432510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:50.521958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0f51a-0f7e-41e3-af1f-6b6a8cc2db96 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:50.558334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75476198-a7c5-44d7-bbdc-47a8b95c9460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:50.563910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75476198-a7c5-44d7-bbdc-47a8b95c9460 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:50.563910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75476198-a7c5-44d7-bbdc-47a8b95c9460 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:50.563910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75476198-a7c5-44d7-bbdc-47a8b95c9460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:50.566136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75476198-a7c5-44d7-bbdc-47a8b95c9460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:50.567596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75476198-a7c5-44d7-bbdc-47a8b95c9460 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-75476198-a7c5-44d7-bbdc-47a8b95c9460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:43:50.580158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:50.581356 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:50.582295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:43:50.582295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:43:50.582295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:43:50.582295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:43:50.582295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:43:50.582295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:43:50.582295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:43:50.582295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:50.583383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 622/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:50.587122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aa363-a47a-4e40-8ee0-f96c1dd03240 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:50.687984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aa363-a47a-4e40-8ee0-f96c1dd03240 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:50.722761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e97750-3bec-40fa-a534-97ac6f0ec118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:50.723419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e97750-3bec-40fa-a534-97ac6f0ec118 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:50.723698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e97750-3bec-40fa-a534-97ac6f0ec118 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:50.723960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e97750-3bec-40fa-a534-97ac6f0ec118 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:50.724658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e97750-3bec-40fa-a534-97ac6f0ec118 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:50.724958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e97750-3bec-40fa-a534-97ac6f0ec118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:50.726439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e97750-3bec-40fa-a534-97ac6f0ec118 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:50.738928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 609/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:43:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:50.745283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75476198-a7c5-44d7-bbdc-47a8b95c9460 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:50.814835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:50.848315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75476198-a7c5-44d7-bbdc-47a8b95c9460 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:50.882557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbde65-263f-4b88-b075-9b8e33354a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:50.883207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbde65-263f-4b88-b075-9b8e33354a84 None admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:50.883510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbde65-263f-4b88-b075-9b8e33354a84 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:50.883781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbde65-263f-4b88-b075-9b8e33354a84 None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1ef51739456e4beb9ae0f107b13d55f5/roles/4f4fe296a2c34480b2b25ce307b326e6` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:50.897819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbde65-263f-4b88-b075-9b8e33354a84 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=1ef51739456e4beb9ae0f107b13d55f5, role_id=4f4fe296a2c34480b2b25ce307b326e6)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:50.904598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bbde65-263f-4b88-b075-9b8e33354a84 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:50.999666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 623/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:43:50 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1ef51739456e4beb9ae0f107b13d55f5/roles/4f4fe296a2c34480b2b25ce307b326e6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:43:52.880965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae8d5-d3c2-420f-8381-bf41f5f9cb37 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:52.881513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae8d5-d3c2-420f-8381-bf41f5f9cb37 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:52.881513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae8d5-d3c2-420f-8381-bf41f5f9cb37 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:52.882841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 610/1233] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:43:52.888210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6a91-50d2-41c1-a5d8-378ed7f68530 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:52.888642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6a91-50d2-41c1-a5d8-378ed7f68530 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:52.888735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6a91-50d2-41c1-a5d8-378ed7f68530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:52.906757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d2ea6a91-50d2-41c1-a5d8-378ed7f68530 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:43:52.907998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d2ea6a91-50d2-41c1-a5d8-378ed7f68530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:43:52.974144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 624/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:43:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 19:43:53.245503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae8d5-d3c2-420f-8381-bf41f5f9cb37 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:53.272648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:53.348030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae8d5-d3c2-420f-8381-bf41f5f9cb37 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:53.381597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76570310-99fa-4112-9e8a-1ead5e663035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:53.387000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76570310-99fa-4112-9e8a-1ead5e663035 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:53.387000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76570310-99fa-4112-9e8a-1ead5e663035 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:53.387000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76570310-99fa-4112-9e8a-1ead5e663035 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:53.393676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76570310-99fa-4112-9e8a-1ead5e663035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-76570310-99fa-4112-9e8a-1ead5e663035 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:43:53.398389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:53.399567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:43:53.400476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 611/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Aug 22 19:43:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:53.406413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6a91-50d2-41c1-a5d8-378ed7f68530 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:53.453626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:53.507522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6a91-50d2-41c1-a5d8-378ed7f68530 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:53.540418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482c4e-fb31-456b-88a7-f3b8d12036ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:53.541019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482c4e-fb31-456b-88a7-f3b8d12036ea None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:53.541297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482c4e-fb31-456b-88a7-f3b8d12036ea None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:53.541569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca482c4e-fb31-456b-88a7-f3b8d12036ea None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:53.542229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca482c4e-fb31-456b-88a7-f3b8d12036ea None admin] RBAC: Adding query filter params (name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:53.543077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca482c4e-fb31-456b-88a7-f3b8d12036ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:53.544758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca482c4e-fb31-456b-88a7-f3b8d12036ea None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:53.552389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 625/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Aug 22 19:43:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:53.558902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76570310-99fa-4112-9e8a-1ead5e663035 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:53.644425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:53.660142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76570310-99fa-4112-9e8a-1ead5e663035 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:53.694082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a23a8-d0ba-4bc5-8cb0-0dec895f66a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:53.694708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a23a8-d0ba-4bc5-8cb0-0dec895f66a2 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:53.694988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a23a8-d0ba-4bc5-8cb0-0dec895f66a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:53.695286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a23a8-d0ba-4bc5-8cb0-0dec895f66a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:53.705398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a23a8-d0ba-4bc5-8cb0-0dec895f66a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:53.710242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a23a8-d0ba-4bc5-8cb0-0dec895f66a2 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-2a5a23a8-d0ba-4bc5-8cb0-0dec895f66a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:43:53.721276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:53.722548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:43:53.723641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:43:53.723641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:53.723641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:43:53.723641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 612/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:53.728335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482c4e-fb31-456b-88a7-f3b8d12036ea None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:53.830977 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca482c4e-fb31-456b-88a7-f3b8d12036ea None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:53.839731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:53.864907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd13a5f-d685-4e37-8e5f-d26766e996d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:53.865507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd13a5f-d685-4e37-8e5f-d26766e996d0 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:53.865787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd13a5f-d685-4e37-8e5f-d26766e996d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:53.866057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd13a5f-d685-4e37-8e5f-d26766e996d0 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:53.866696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd13a5f-d685-4e37-8e5f-d26766e996d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:53.866998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd13a5f-d685-4e37-8e5f-d26766e996d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:53.868409 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd13a5f-d685-4e37-8e5f-d26766e996d0 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:53.880986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 626/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:53.887048 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a23a8-d0ba-4bc5-8cb0-0dec895f66a2 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:53.987013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a23a8-d0ba-4bc5-8cb0-0dec895f66a2 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:54.019939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751f32e-f86f-49af-b112-2e8ff3e6d54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:54.020551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751f32e-f86f-49af-b112-2e8ff3e6d54b None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:54.020826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751f32e-f86f-49af-b112-2e8ff3e6d54b None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:54.021091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751f32e-f86f-49af-b112-2e8ff3e6d54b None admin] PATH_INFO: `/v3/users/placement` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:54.023853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:54.029412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751f32e-f86f-49af-b112-2e8ff3e6d54b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:54.030921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751f32e-f86f-49af-b112-2e8ff3e6d54b None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-b751f32e-f86f-49af-b112-2e8ff3e6d54b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:43:54.041807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:54.046503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:43:54.047708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 613/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:54.049404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd13a5f-d685-4e37-8e5f-d26766e996d0 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:54.151599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd13a5f-d685-4e37-8e5f-d26766e996d0 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:54.186678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36992e3-cb98-43af-a771-6b58350145ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:54.187406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36992e3-cb98-43af-a771-6b58350145ea None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:54.187747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36992e3-cb98-43af-a771-6b58350145ea None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:54.188040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36992e3-cb98-43af-a771-6b58350145ea None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:54.188764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36992e3-cb98-43af-a771-6b58350145ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:54.189064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36992e3-cb98-43af-a771-6b58350145ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:54.190488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36992e3-cb98-43af-a771-6b58350145ea None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:54.207917 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 627/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 19:43:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:54.213795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751f32e-f86f-49af-b112-2e8ff3e6d54b None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:54.317374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751f32e-f86f-49af-b112-2e8ff3e6d54b None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:54.350321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581784-9251-4f88-916f-725d989e9b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:54.350912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581784-9251-4f88-916f-725d989e9b33 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:54.351185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581784-9251-4f88-916f-725d989e9b33 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:54.351480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581784-9251-4f88-916f-725d989e9b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:54.414028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:54.421036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9581784-9251-4f88-916f-725d989e9b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:54.422545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9581784-9251-4f88-916f-725d989e9b33 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:54.522352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 614/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:43:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:43:54.528322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36992e3-cb98-43af-a771-6b58350145ea None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:54.555783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:54.628002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36992e3-cb98-43af-a771-6b58350145ea None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:54.663660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a473e49-d903-4fb7-a075-4bb4443be5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:54.664328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a473e49-d903-4fb7-a075-4bb4443be5b8 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:54.664553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a473e49-d903-4fb7-a075-4bb4443be5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:54.664848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a473e49-d903-4fb7-a075-4bb4443be5b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:54.675430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a473e49-d903-4fb7-a075-4bb4443be5b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:54.676921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a473e49-d903-4fb7-a075-4bb4443be5b8 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-4a473e49-d903-4fb7-a075-4bb4443be5b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:43:54.691264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:54.692345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:43:54.693294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:43:54.693294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:54.693294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:54.693294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 628/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:54.698264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581784-9251-4f88-916f-725d989e9b33 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:54.793658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:54.799672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581784-9251-4f88-916f-725d989e9b33 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:54.832632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251093e-fc39-484b-9268-2f8ec909bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:54.833231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251093e-fc39-484b-9268-2f8ec909bef7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:54.833502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251093e-fc39-484b-9268-2f8ec909bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:54.833767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251093e-fc39-484b-9268-2f8ec909bef7 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:54.834401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251093e-fc39-484b-9268-2f8ec909bef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:54.834776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251093e-fc39-484b-9268-2f8ec909bef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:54.836224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251093e-fc39-484b-9268-2f8ec909bef7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:54.847783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 615/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:54.853585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a473e49-d903-4fb7-a075-4bb4443be5b8 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:54.933792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:54.954411 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a473e49-d903-4fb7-a075-4bb4443be5b8 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:54.987605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dc818-efe1-4b37-90f5-27ae975efa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:54.988223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dc818-efe1-4b37-90f5-27ae975efa12 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:54.988495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dc818-efe1-4b37-90f5-27ae975efa12 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:54.988760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dc818-efe1-4b37-90f5-27ae975efa12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:54.995498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dc818-efe1-4b37-90f5-27ae975efa12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:54.997049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dc818-efe1-4b37-90f5-27ae975efa12 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-453dc818-efe1-4b37-90f5-27ae975efa12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:43:55.008914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:55.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:55.011301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:43:55.011301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:43:55.011301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:43:55.011301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:43:55.011301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:43:55.011301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:43:55.011301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:43:55.011301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:55.011301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 629/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:43:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:55.016496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251093e-fc39-484b-9268-2f8ec909bef7 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:55.116991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251093e-fc39-484b-9268-2f8ec909bef7 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:55.150822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aebd8-d560-450c-a2f2-9a86a8b07b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:55.151470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aebd8-d560-450c-a2f2-9a86a8b07b25 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:55.151745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aebd8-d560-450c-a2f2-9a86a8b07b25 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:55.152012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aebd8-d560-450c-a2f2-9a86a8b07b25 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:55.153353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aebd8-d560-450c-a2f2-9a86a8b07b25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:55.153646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aebd8-d560-450c-a2f2-9a86a8b07b25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:55.155099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aebd8-d560-450c-a2f2-9a86a8b07b25 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:55.167203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 616/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:55.173968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dc818-efe1-4b37-90f5-27ae975efa12 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:55.274712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dc818-efe1-4b37-90f5-27ae975efa12 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:55.307642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf719214-c0ce-484c-bcfe-1b49f9bbdc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:55.308238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719214-c0ce-484c-bcfe-1b49f9bbdc6d None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:55.309122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719214-c0ce-484c-bcfe-1b49f9bbdc6d None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:55.309437 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf719214-c0ce-484c-bcfe-1b49f9bbdc6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:55.310157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf719214-c0ce-484c-bcfe-1b49f9bbdc6d None admin] RBAC: Adding query filter params (role.id=4f4fe296a2c34480b2b25ce307b326e6, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1ef51739456e4beb9ae0f107b13d55f5) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:55.310456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf719214-c0ce-484c-bcfe-1b49f9bbdc6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:55.311891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf719214-c0ce-484c-bcfe-1b49f9bbdc6d None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:55.317545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 630/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:43:55 2022] GET /identity/v3/role_assignments?user.id=1ef51739456e4beb9ae0f107b13d55f5&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=4f4fe296a2c34480b2b25ce307b326e6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:57.329420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a613a-ca63-4a08-a266-bf5e562ff707 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:57.329953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a613a-ca63-4a08-a266-bf5e562ff707 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:57.329953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a613a-ca63-4a08-a266-bf5e562ff707 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:57.331314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 617/1247] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:43:57.336721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e625652-9b4b-4130-8b99-cf59ed25be88 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:57.337142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e625652-9b4b-4130-8b99-cf59ed25be88 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:57.337266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e625652-9b4b-4130-8b99-cf59ed25be88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:57.344199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:57.356957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0e625652-9b4b-4130-8b99-cf59ed25be88 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:43:57.358141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0e625652-9b4b-4130-8b99-cf59ed25be88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:43:57.425012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 631/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:43:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:43:57.692514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a613a-ca63-4a08-a266-bf5e562ff707 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:57.711932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:57.796859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a613a-ca63-4a08-a266-bf5e562ff707 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:57.830823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce26ae-e848-4c48-bc2c-dae45922ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:57.831472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce26ae-e848-4c48-bc2c-dae45922ee4d None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:57.831749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce26ae-e848-4c48-bc2c-dae45922ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:57.832016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce26ae-e848-4c48-bc2c-dae45922ee4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:57.842512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce26ae-e848-4c48-bc2c-dae45922ee4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-ddce26ae-e848-4c48-bc2c-dae45922ee4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:43:57.847587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:57.848778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:43:57.849813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 618/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:57.854847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e625652-9b4b-4130-8b99-cf59ed25be88 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:57.955837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e625652-9b4b-4130-8b99-cf59ed25be88 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:57.989422 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:57.994227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70ca41-cada-4025-afca-754a01377fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:57.994834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70ca41-cada-4025-afca-754a01377fd4 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:57.995113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70ca41-cada-4025-afca-754a01377fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:57.995418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70ca41-cada-4025-afca-754a01377fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:57.996740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70ca41-cada-4025-afca-754a01377fd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:57.997148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70ca41-cada-4025-afca-754a01377fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:57.998527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70ca41-cada-4025-afca-754a01377fd4 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:58.006701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 632/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:58.013495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce26ae-e848-4c48-bc2c-dae45922ee4d None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:58.092795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:58.116114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce26ae-e848-4c48-bc2c-dae45922ee4d None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:58.149606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416550c-5926-4adb-8a56-c64650192fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:58.150226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416550c-5926-4adb-8a56-c64650192fda None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:58.150501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416550c-5926-4adb-8a56-c64650192fda None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:58.150766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416550c-5926-4adb-8a56-c64650192fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:58.162272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416550c-5926-4adb-8a56-c64650192fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:58.163751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416550c-5926-4adb-8a56-c64650192fda None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-d416550c-5926-4adb-8a56-c64650192fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:43:58.178961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:58.183167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:43:58.184341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:43:58.184341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:58.184341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:43:58.184341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 619/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:58.186377 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70ca41-cada-4025-afca-754a01377fd4 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:58.288092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70ca41-cada-4025-afca-754a01377fd4 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:58.322190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc67b5d-84a0-4acd-b1f7-cf0976f79cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:58.322756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc67b5d-84a0-4acd-b1f7-cf0976f79cf4 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:58.323036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc67b5d-84a0-4acd-b1f7-cf0976f79cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:58.323335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc67b5d-84a0-4acd-b1f7-cf0976f79cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:58.323981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc67b5d-84a0-4acd-b1f7-cf0976f79cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:58.324444 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc67b5d-84a0-4acd-b1f7-cf0976f79cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:58.325812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc67b5d-84a0-4acd-b1f7-cf0976f79cf4 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:58.337373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 633/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:58.343637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416550c-5926-4adb-8a56-c64650192fda None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:58.446201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416550c-5926-4adb-8a56-c64650192fda None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:58.473573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:58.481084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46049-2cf3-49db-8abf-57408bbf0343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:58.481710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46049-2cf3-49db-8abf-57408bbf0343 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:58.481988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46049-2cf3-49db-8abf-57408bbf0343 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:58.482256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f46049-2cf3-49db-8abf-57408bbf0343 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:58.489906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f46049-2cf3-49db-8abf-57408bbf0343 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:58.491374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f46049-2cf3-49db-8abf-57408bbf0343 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-24f46049-2cf3-49db-8abf-57408bbf0343 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:43:58.502481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:58.503673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:43:58.507184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 620/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:58.509890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc67b5d-84a0-4acd-b1f7-cf0976f79cf4 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:58.565404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:58.610939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc67b5d-84a0-4acd-b1f7-cf0976f79cf4 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:58.646215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f592dd-987d-4fe8-b0ac-b1b47987e6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:58.646815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f592dd-987d-4fe8-b0ac-b1b47987e6f2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:58.647091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f592dd-987d-4fe8-b0ac-b1b47987e6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:58.647392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f592dd-987d-4fe8-b0ac-b1b47987e6f2 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:58.648114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f592dd-987d-4fe8-b0ac-b1b47987e6f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:58.648421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f592dd-987d-4fe8-b0ac-b1b47987e6f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:58.649841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f592dd-987d-4fe8-b0ac-b1b47987e6f2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:58.667847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 634/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 19:43:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:58.673656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46049-2cf3-49db-8abf-57408bbf0343 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:58.774411 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f46049-2cf3-49db-8abf-57408bbf0343 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:58.811489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7c244-89f1-4a88-9dcc-b7e7dc4cf82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:58.812082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7c244-89f1-4a88-9dcc-b7e7dc4cf82c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:58.812358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7c244-89f1-4a88-9dcc-b7e7dc4cf82c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:58.812624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7c244-89f1-4a88-9dcc-b7e7dc4cf82c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:58.868928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:58.881688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7c244-89f1-4a88-9dcc-b7e7dc4cf82c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:58.884558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7c244-89f1-4a88-9dcc-b7e7dc4cf82c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:58.981984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 621/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:43:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:43:58.987874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f592dd-987d-4fe8-b0ac-b1b47987e6f2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:59.085080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f592dd-987d-4fe8-b0ac-b1b47987e6f2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:59.098375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:59.119622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38235-4464-4ff4-82f6-7b607cb89b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:59.120189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38235-4464-4ff4-82f6-7b607cb89b56 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:59.120464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38235-4464-4ff4-82f6-7b607cb89b56 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:59.120733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38235-4464-4ff4-82f6-7b607cb89b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:59.130651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b38235-4464-4ff4-82f6-7b607cb89b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:59.132129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b38235-4464-4ff4-82f6-7b607cb89b56 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-57b38235-4464-4ff4-82f6-7b607cb89b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:43:59.146761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:59.147785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:43:59.148959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:43:59.148959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:43:59.148959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:59.148959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 635/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:59.154826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7c244-89f1-4a88-9dcc-b7e7dc4cf82c None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:59.242494 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:59.255233 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7c244-89f1-4a88-9dcc-b7e7dc4cf82c None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:59.288813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e9d33-634c-4353-b8bc-20d7a4889047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:59.289410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e9d33-634c-4353-b8bc-20d7a4889047 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:59.289734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e9d33-634c-4353-b8bc-20d7a4889047 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:59.290009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e9d33-634c-4353-b8bc-20d7a4889047 None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:59.290650 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e9d33-634c-4353-b8bc-20d7a4889047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:59.290952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e9d33-634c-4353-b8bc-20d7a4889047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:59.292348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e9d33-634c-4353-b8bc-20d7a4889047 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:59.304008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 622/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:43:59.310493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38235-4464-4ff4-82f6-7b607cb89b56 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:59.411724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38235-4464-4ff4-82f6-7b607cb89b56 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:59.445571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f311f-330c-45b4-a467-21a8438f0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:59.446299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f311f-330c-45b4-a467-21a8438f0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:59.446601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f311f-330c-45b4-a467-21a8438f0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:59.446867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f311f-330c-45b4-a467-21a8438f0ea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:59.453637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f311f-330c-45b4-a467-21a8438f0ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:59.455084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f311f-330c-45b4-a467-21a8438f0ea7 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-b83f311f-330c-45b4-a467-21a8438f0ea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:43:59.466387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:43:59.467447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:43:59.468564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:43:59.468564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:43:59.468564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:43:59.468564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:43:59.468564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:43:59.468564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:43:59.468564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:43:59.468564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:43:59.468564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 636/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:43:59.473489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e9d33-634c-4353-b8bc-20d7a4889047 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:59.574666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e9d33-634c-4353-b8bc-20d7a4889047 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:59.609096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69179c36-db28-4745-aa0a-ac0f382e26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:59.609698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69179c36-db28-4745-aa0a-ac0f382e26e6 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:59.609973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69179c36-db28-4745-aa0a-ac0f382e26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:59.610241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69179c36-db28-4745-aa0a-ac0f382e26e6 None admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:59.610939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69179c36-db28-4745-aa0a-ac0f382e26e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:59.611262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69179c36-db28-4745-aa0a-ac0f382e26e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:59.612691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69179c36-db28-4745-aa0a-ac0f382e26e6 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:59.625512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 623/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:43:59.632062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f311f-330c-45b4-a467-21a8438f0ea7 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:43:59.658317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:43:59.733224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f311f-330c-45b4-a467-21a8438f0ea7 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:43:59.767336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37715-7573-44a8-9e23-026df7196f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:43:59.767937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37715-7573-44a8-9e23-026df7196f0b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:43:59.768214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37715-7573-44a8-9e23-026df7196f0b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:43:59.768483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37715-7573-44a8-9e23-026df7196f0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:43:59.769204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d37715-7573-44a8-9e23-026df7196f0b None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1ef51739456e4beb9ae0f107b13d55f5) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:43:59.769508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d37715-7573-44a8-9e23-026df7196f0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:43:59.770929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d37715-7573-44a8-9e23-026df7196f0b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:43:59.776801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 637/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:43:59 2022] GET /identity/v3/role_assignments?user.id=1ef51739456e4beb9ae0f107b13d55f5&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=9ec7f759c0a64655b794dfb597930076 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:01.637678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564710bd-0bff-46ea-9d37-595790d56670 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:01.638322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564710bd-0bff-46ea-9d37-595790d56670 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:01.638322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564710bd-0bff-46ea-9d37-595790d56670 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:01.639856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 624/1261] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:44:01.645034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3a8d0-5e1b-4934-bd25-9721228d5a9b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:01.645510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3a8d0-5e1b-4934-bd25-9721228d5a9b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:01.645620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3a8d0-5e1b-4934-bd25-9721228d5a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:01.664487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b2a3a8d0-5e1b-4934-bd25-9721228d5a9b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:44:01.665706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b2a3a8d0-5e1b-4934-bd25-9721228d5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:44:01.732277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 638/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:44:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:44:02.003013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564710bd-0bff-46ea-9d37-595790d56670 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:02.015346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:02.106750 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564710bd-0bff-46ea-9d37-595790d56670 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:02.141049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2cd59-8565-4ed3-a298-bd0ad67952e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:02.141688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2cd59-8565-4ed3-a298-bd0ad67952e8 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:02.141964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2cd59-8565-4ed3-a298-bd0ad67952e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:02.146727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2cd59-8565-4ed3-a298-bd0ad67952e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:02.152909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2cd59-8565-4ed3-a298-bd0ad67952e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-f2e2cd59-8565-4ed3-a298-bd0ad67952e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:44:02.157609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:02.158714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:44:02.164244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 625/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:02.165123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3a8d0-5e1b-4934-bd25-9721228d5a9b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:02.183557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:02.266080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3a8d0-5e1b-4934-bd25-9721228d5a9b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:02.299994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275c53-d267-41d0-a8de-2af90a219b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:02.300641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275c53-d267-41d0-a8de-2af90a219b5e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:02.300920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275c53-d267-41d0-a8de-2af90a219b5e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:02.301193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e275c53-d267-41d0-a8de-2af90a219b5e None admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:02.301999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275c53-d267-41d0-a8de-2af90a219b5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:02.302300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275c53-d267-41d0-a8de-2af90a219b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:02.303719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e275c53-d267-41d0-a8de-2af90a219b5e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:02.312236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 639/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:02.317983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2cd59-8565-4ed3-a298-bd0ad67952e8 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:02.386182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:02.423007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2cd59-8565-4ed3-a298-bd0ad67952e8 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:02.456840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65582b-0fc4-406f-b020-e49c5cf2cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:02.457891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65582b-0fc4-406f-b020-e49c5cf2cad0 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:02.458168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65582b-0fc4-406f-b020-e49c5cf2cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:02.458435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65582b-0fc4-406f-b020-e49c5cf2cad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:02.469522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65582b-0fc4-406f-b020-e49c5cf2cad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:02.470958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65582b-0fc4-406f-b020-e49c5cf2cad0 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-1f65582b-0fc4-406f-b020-e49c5cf2cad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:44:02.485343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:02.486592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:44:02.487768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:44:02.487768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:44:02.487768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:44:02.487768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 626/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:02.492186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275c53-d267-41d0-a8de-2af90a219b5e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:02.575690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:02.594751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e275c53-d267-41d0-a8de-2af90a219b5e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:02.629478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e6cab-50d3-429a-8176-442e075a1864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:02.630099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e6cab-50d3-429a-8176-442e075a1864 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:02.630362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e6cab-50d3-429a-8176-442e075a1864 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:02.630630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e6cab-50d3-429a-8176-442e075a1864 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:02.631361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e6cab-50d3-429a-8176-442e075a1864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:02.631675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e6cab-50d3-429a-8176-442e075a1864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:02.633221 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e6cab-50d3-429a-8176-442e075a1864 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:02.644907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 640/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:02.650645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65582b-0fc4-406f-b020-e49c5cf2cad0 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:02.750619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65582b-0fc4-406f-b020-e49c5cf2cad0 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:02.769912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:02.784251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12321b25-ee36-42f9-9c30-23ae35f3522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:02.784871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12321b25-ee36-42f9-9c30-23ae35f3522f None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:02.785145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12321b25-ee36-42f9-9c30-23ae35f3522f None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:02.785409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12321b25-ee36-42f9-9c30-23ae35f3522f None admin] PATH_INFO: `/v3/users/placement` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:02.793823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12321b25-ee36-42f9-9c30-23ae35f3522f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:02.795281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12321b25-ee36-42f9-9c30-23ae35f3522f None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-12321b25-ee36-42f9-9c30-23ae35f3522f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:44:02.806184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:02.807179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:44:02.808223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 627/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:44:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:02.813167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e6cab-50d3-429a-8176-442e075a1864 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:02.912761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e6cab-50d3-429a-8176-442e075a1864 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:02.947388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b92b19-579a-4989-94a2-c4d66760a870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:02.947994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b92b19-579a-4989-94a2-c4d66760a870 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:02.948270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b92b19-579a-4989-94a2-c4d66760a870 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:02.948540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b92b19-579a-4989-94a2-c4d66760a870 None admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:02.949308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b92b19-579a-4989-94a2-c4d66760a870 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:02.949604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b92b19-579a-4989-94a2-c4d66760a870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:02.951153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b92b19-579a-4989-94a2-c4d66760a870 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:02.960154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:02.968492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 641/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 19:44:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:02.974205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12321b25-ee36-42f9-9c30-23ae35f3522f None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:03.078051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12321b25-ee36-42f9-9c30-23ae35f3522f None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:03.115834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d5e08-1c2b-49ea-ab57-f832c26b3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:03.116451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d5e08-1c2b-49ea-ab57-f832c26b3a57 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:03.116726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d5e08-1c2b-49ea-ab57-f832c26b3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:03.116988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d5e08-1c2b-49ea-ab57-f832c26b3a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:03.128924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d5e08-1c2b-49ea-ab57-f832c26b3a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:03.130658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d5e08-1c2b-49ea-ab57-f832c26b3a57 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-a35d5e08-1c2b-49ea-ab57-f832c26b3a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:44:03.145108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:03.146273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:44:03.147179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:44:03.147179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:44:03.147179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:44:03.147179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 628/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:03.152148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b92b19-579a-4989-94a2-c4d66760a870 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:03.252940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b92b19-579a-4989-94a2-c4d66760a870 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:03.287045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86152-1974-4ae3-9781-0ab2bb1892b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:03.287670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86152-1974-4ae3-9781-0ab2bb1892b6 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:03.287945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86152-1974-4ae3-9781-0ab2bb1892b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:03.288211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a86152-1974-4ae3-9781-0ab2bb1892b6 None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:03.288865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a86152-1974-4ae3-9781-0ab2bb1892b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:03.289182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a86152-1974-4ae3-9781-0ab2bb1892b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:03.290535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a86152-1974-4ae3-9781-0ab2bb1892b6 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:03.301628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 642/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:03.308203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d5e08-1c2b-49ea-ab57-f832c26b3a57 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:03.341652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:03.410102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d5e08-1c2b-49ea-ab57-f832c26b3a57 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:03.444632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3598-6f89-4518-a47d-a71e78598b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:03.445332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3598-6f89-4518-a47d-a71e78598b27 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:03.445606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3598-6f89-4518-a47d-a71e78598b27 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:03.445875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed3598-6f89-4518-a47d-a71e78598b27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:03.453068 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed3598-6f89-4518-a47d-a71e78598b27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:03.454493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed3598-6f89-4518-a47d-a71e78598b27 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-54ed3598-6f89-4518-a47d-a71e78598b27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:44:03.465394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:03.466481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:03.467633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:44:03.467633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:44:03.467633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:44:03.467633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:44:03.467633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:44:03.467633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:44:03.467633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:44:03.467633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:44:03.467633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 629/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:03.472631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86152-1974-4ae3-9781-0ab2bb1892b6 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:03.532672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:03.573580 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a86152-1974-4ae3-9781-0ab2bb1892b6 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:03.607762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd8cbb-a634-4105-87be-94ab1584ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:03.608363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8cbb-a634-4105-87be-94ab1584ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:03.608638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8cbb-a634-4105-87be-94ab1584ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:03.608901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8cbb-a634-4105-87be-94ab1584ddb1 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:03.609638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd8cbb-a634-4105-87be-94ab1584ddb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:03.609934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd8cbb-a634-4105-87be-94ab1584ddb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:03.611378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd8cbb-a634-4105-87be-94ab1584ddb1 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:03.625103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 643/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:03.631354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3598-6f89-4518-a47d-a71e78598b27 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:03.723634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:03.732756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed3598-6f89-4518-a47d-a71e78598b27 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:03.766408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cfd3f-7ecc-4263-894f-2c67d4787617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:03.767050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cfd3f-7ecc-4263-894f-2c67d4787617 None admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:03.767359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cfd3f-7ecc-4263-894f-2c67d4787617 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:03.767633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cfd3f-7ecc-4263-894f-2c67d4787617 None admin] PATH_INFO: `/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1ef51739456e4beb9ae0f107b13d55f5/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:03.769551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cfd3f-7ecc-4263-894f-2c67d4787617 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fec275f9ad4488bab9a1700808425d3, user_id=1ef51739456e4beb9ae0f107b13d55f5, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:03.770995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cfd3f-7ecc-4263-894f-2c67d4787617 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:03.849073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 630/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Aug 22 19:44:03 2022] PUT /identity/v3/projects/7fec275f9ad4488bab9a1700808425d3/users/1ef51739456e4beb9ae0f107b13d55f5/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:44:05.737844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0c45-4fee-4434-8d20-1842f081f682 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:05.738375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0c45-4fee-4434-8d20-1842f081f682 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:05.738375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0c45-4fee-4434-8d20-1842f081f682 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:05.739765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 644/1274] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:44:05.744999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d8ad-b3de-4f63-8ca9-da2a752f28cd None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:05.745530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d8ad-b3de-4f63-8ca9-da2a752f28cd None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:05.745530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d8ad-b3de-4f63-8ca9-da2a752f28cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:05.764545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-2921d8ad-b3de-4f63-8ca9-da2a752f28cd None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:44:05.765732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2921d8ad-b3de-4f63-8ca9-da2a752f28cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:44:05.833864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 631/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:44:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:44:06.103167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0c45-4fee-4434-8d20-1842f081f682 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:06.206891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0c45-4fee-4434-8d20-1842f081f682 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:06.224045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:06.241126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c7100-a662-403b-868a-e16a0a83f146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:06.241757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7100-a662-403b-868a-e16a0a83f146 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:06.242029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7100-a662-403b-868a-e16a0a83f146 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:06.242297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7100-a662-403b-868a-e16a0a83f146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:06.252713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c7100-a662-403b-868a-e16a0a83f146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-098c7100-a662-403b-868a-e16a0a83f146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 19:44:06.257665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:06.258772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:06.259739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 645/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Aug 22 19:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:06.265748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d8ad-b3de-4f63-8ca9-da2a752f28cd None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:06.358284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:06.385590 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d8ad-b3de-4f63-8ca9-da2a752f28cd None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:06.421537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16687-4a81-409b-8ae8-e5c4053c0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:06.422181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16687-4a81-409b-8ae8-e5c4053c0813 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:06.422508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16687-4a81-409b-8ae8-e5c4053c0813 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:06.422804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab16687-4a81-409b-8ae8-e5c4053c0813 None admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:06.423534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab16687-4a81-409b-8ae8-e5c4053c0813 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:06.423875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab16687-4a81-409b-8ae8-e5c4053c0813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:06.425276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab16687-4a81-409b-8ae8-e5c4053c0813 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:06.433220 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 632/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Aug 22 19:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:06.439112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c7100-a662-403b-868a-e16a0a83f146 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:06.540365 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c7100-a662-403b-868a-e16a0a83f146 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:06.576278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84eca6-802b-4ca8-80ff-1f43b520e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:06.576902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84eca6-802b-4ca8-80ff-1f43b520e55b None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:06.577206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84eca6-802b-4ca8-80ff-1f43b520e55b None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:06.577451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84eca6-802b-4ca8-80ff-1f43b520e55b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:06.587515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84eca6-802b-4ca8-80ff-1f43b520e55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:06.588954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84eca6-802b-4ca8-80ff-1f43b520e55b None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-af84eca6-802b-4ca8-80ff-1f43b520e55b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:44:06.603786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:06.604914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:44:06.606591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:44:06.606591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:44:06.606591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:06.606591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 646/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:06.611966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16687-4a81-409b-8ae8-e5c4053c0813 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:06.712596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab16687-4a81-409b-8ae8-e5c4053c0813 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:06.745854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b86d5-552c-4424-a9c2-b0fcb42b171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:06.747158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b86d5-552c-4424-a9c2-b0fcb42b171c None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:06.747306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b86d5-552c-4424-a9c2-b0fcb42b171c None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:06.747548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b86d5-552c-4424-a9c2-b0fcb42b171c None admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:06.748182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b86d5-552c-4424-a9c2-b0fcb42b171c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:06.748476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b86d5-552c-4424-a9c2-b0fcb42b171c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:06.749822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b86d5-552c-4424-a9c2-b0fcb42b171c None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:06.761564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 633/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:06.768000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84eca6-802b-4ca8-80ff-1f43b520e55b None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:06.800090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:06.870260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84eca6-802b-4ca8-80ff-1f43b520e55b None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:06.905923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c89cf-2eee-40a6-86db-c09932c4e4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:06.906546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c89cf-2eee-40a6-86db-c09932c4e4f2 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:06.906824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c89cf-2eee-40a6-86db-c09932c4e4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:06.907092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c89cf-2eee-40a6-86db-c09932c4e4f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:06.913981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c89cf-2eee-40a6-86db-c09932c4e4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:06.915468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c89cf-2eee-40a6-86db-c09932c4e4f2 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-a77c89cf-2eee-40a6-86db-c09932c4e4f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 19:44:06.927448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:06.928550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:06.929647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 647/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:44:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:06.935185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b86d5-552c-4424-a9c2-b0fcb42b171c None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:06.938987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:07.033248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b86d5-552c-4424-a9c2-b0fcb42b171c None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:07.066532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0377-a0a3-4668-b865-888bcfe52e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:07.067119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0377-a0a3-4668-b865-888bcfe52e67 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:07.067423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0377-a0a3-4668-b865-888bcfe52e67 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:07.067689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0377-a0a3-4668-b865-888bcfe52e67 None admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:07.068460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec0377-a0a3-4668-b865-888bcfe52e67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:07.068764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec0377-a0a3-4668-b865-888bcfe52e67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:07.070193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec0377-a0a3-4668-b865-888bcfe52e67 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:07.087422 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 634/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Aug 22 19:44:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:07.093813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c89cf-2eee-40a6-86db-c09932c4e4f2 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:07.189709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:07.198935 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c89cf-2eee-40a6-86db-c09932c4e4f2 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:07.233963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50dd8-8d91-48de-bfa1-52b6c83a8a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:07.234566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50dd8-8d91-48de-bfa1-52b6c83a8a1c None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:07.234845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50dd8-8d91-48de-bfa1-52b6c83a8a1c None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:07.235117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e50dd8-8d91-48de-bfa1-52b6c83a8a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:07.301619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50dd8-8d91-48de-bfa1-52b6c83a8a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:07.303068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e50dd8-8d91-48de-bfa1-52b6c83a8a1c None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:07.391615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:07.402753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 648/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Aug 22 19:44:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 19:44:07.408660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0377-a0a3-4668-b865-888bcfe52e67 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:07.469988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:07.507530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0377-a0a3-4668-b865-888bcfe52e67 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:07.542380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be0095-3ccb-4c4b-a805-0005b0884e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:07.543019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be0095-3ccb-4c4b-a805-0005b0884e92 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:07.543315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be0095-3ccb-4c4b-a805-0005b0884e92 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:07.543580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be0095-3ccb-4c4b-a805-0005b0884e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:07.553451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be0095-3ccb-4c4b-a805-0005b0884e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:07.554882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be0095-3ccb-4c4b-a805-0005b0884e92 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-a8be0095-3ccb-4c4b-a805-0005b0884e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 19:44:07.570589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:07.571741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 19:44:07.572953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 19:44:07.572953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 19:44:07.572953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:44:07.572953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 635/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:07.578300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50dd8-8d91-48de-bfa1-52b6c83a8a1c None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:07.679278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e50dd8-8d91-48de-bfa1-52b6c83a8a1c None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:07.713633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c55820-8155-4ca4-ae65-e769c621661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:07.714236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55820-8155-4ca4-ae65-e769c621661e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:07.714513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55820-8155-4ca4-ae65-e769c621661e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:07.715551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55820-8155-4ca4-ae65-e769c621661e None admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:07.716224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c55820-8155-4ca4-ae65-e769c621661e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:07.716499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c55820-8155-4ca4-ae65-e769c621661e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:07.717860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c55820-8155-4ca4-ae65-e769c621661e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:07.728944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 649/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Aug 22 19:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:07.734627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be0095-3ccb-4c4b-a805-0005b0884e92 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:07.836196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be0095-3ccb-4c4b-a805-0005b0884e92 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:07.850814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:07.871248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f769b0-154c-4ca0-a688-a73b46fb9408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:07.871880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f769b0-154c-4ca0-a688-a73b46fb9408 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:07.872154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f769b0-154c-4ca0-a688-a73b46fb9408 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:07.872420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f769b0-154c-4ca0-a688-a73b46fb9408 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:07.878891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f769b0-154c-4ca0-a688-a73b46fb9408 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:07.882353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f769b0-154c-4ca0-a688-a73b46fb9408 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application [None req-b4f769b0-154c-4ca0-a688-a73b46fb9408 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 19:44:07.891556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:07.892663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:07.894072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 19:44:07.894072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 19:44:07.894072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 19:44:07.894072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 19:44:07.894072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 19:44:07.894072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 19:44:07.894072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 19:44:07.894072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: ERROR keystone.server.flask.application Aug 22 19:44:07.894072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 636/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Aug 22 19:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:07.898618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c55820-8155-4ca4-ae65-e769c621661e None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:07.948967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:08.003600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c55820-8155-4ca4-ae65-e769c621661e None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:08.037120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2ab93-3399-4434-91e8-8088ca900271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:08.037710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ab93-3399-4434-91e8-8088ca900271 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:08.037985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ab93-3399-4434-91e8-8088ca900271 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:08.038250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ab93-3399-4434-91e8-8088ca900271 None admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:08.038931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2ab93-3399-4434-91e8-8088ca900271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:08.039258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2ab93-3399-4434-91e8-8088ca900271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:08.040686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2ab93-3399-4434-91e8-8088ca900271 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:08.053392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 650/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Aug 22 19:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:08.059992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f769b0-154c-4ca0-a688-a73b46fb9408 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:08.161618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f769b0-154c-4ca0-a688-a73b46fb9408 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:08.194752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd042473-373a-4e04-8b44-39344cd2def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:08.195375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd042473-373a-4e04-8b44-39344cd2def7 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:08.195654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd042473-373a-4e04-8b44-39344cd2def7 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:08.195924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd042473-373a-4e04-8b44-39344cd2def7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:08.196654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd042473-373a-4e04-8b44-39344cd2def7 None admin] RBAC: Adding query filter params (role.id=9ec7f759c0a64655b794dfb597930076, scope.project.id=7fec275f9ad4488bab9a1700808425d3, user.id=1ef51739456e4beb9ae0f107b13d55f5) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:08.196960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd042473-373a-4e04-8b44-39344cd2def7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:08.198395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd042473-373a-4e04-8b44-39344cd2def7 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:08.204637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 637/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Aug 22 19:44:08 2022] GET /identity/v3/role_assignments?user.id=1ef51739456e4beb9ae0f107b13d55f5&scope.project.id=7fec275f9ad4488bab9a1700808425d3&role.id=9ec7f759c0a64655b794dfb597930076 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:10.158852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ad969-3fef-4bf1-974a-abf157285f1a None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:10.159500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ad969-3fef-4bf1-974a-abf157285f1a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:10.159600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ad969-3fef-4bf1-974a-abf157285f1a None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:10.160992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 651/1288] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:44:10.166248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5c65-11af-40ec-aacd-285fc1dbb5a4 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:10.166648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5c65-11af-40ec-aacd-285fc1dbb5a4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:10.166781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5c65-11af-40ec-aacd-285fc1dbb5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:10.186467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4e2e5c65-11af-40ec-aacd-285fc1dbb5a4 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:44:10.187699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4e2e5c65-11af-40ec-aacd-285fc1dbb5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:44:10.218230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:10.254968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 638/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:44:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:44:10.521864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ad969-3fef-4bf1-974a-abf157285f1a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:10.624375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ad969-3fef-4bf1-974a-abf157285f1a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:10.635364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:10.658135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536ecd8-be18-4e4a-a097-cdc6f27b8088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:10.658776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536ecd8-be18-4e4a-a097-cdc6f27b8088 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:10.659033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536ecd8-be18-4e4a-a097-cdc6f27b8088 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:10.659328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536ecd8-be18-4e4a-a097-cdc6f27b8088 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:10.659905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536ecd8-be18-4e4a-a097-cdc6f27b8088 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:10.661267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536ecd8-be18-4e4a-a097-cdc6f27b8088 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-9536ecd8-be18-4e4a-a097-cdc6f27b8088 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:10.670269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:10.671550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:10.672618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 652/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:44:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:10.677729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5c65-11af-40ec-aacd-285fc1dbb5a4 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:10.778756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5c65-11af-40ec-aacd-285fc1dbb5a4 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:10.812190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9663b-05bc-4d46-894b-c82b92c654ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:10.813205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9663b-05bc-4d46-894b-c82b92c654ee None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:10.813205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9663b-05bc-4d46-894b-c82b92c654ee None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:10.813416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9663b-05bc-4d46-894b-c82b92c654ee None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:10.813921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9663b-05bc-4d46-894b-c82b92c654ee None admin] RBAC: Adding query filter params (name=placement) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:10.814218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9663b-05bc-4d46-894b-c82b92c654ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:10.815625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9663b-05bc-4d46-894b-c82b92c654ee None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:10.820385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 639/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Aug 22 19:44:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:10.826425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536ecd8-be18-4e4a-a097-cdc6f27b8088 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:10.930942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536ecd8-be18-4e4a-a097-cdc6f27b8088 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:10.963746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5394370-b41d-4b4d-93c2-cea10b3a108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:10.964341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5394370-b41d-4b4d-93c2-cea10b3a108e None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:10.965121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5394370-b41d-4b4d-93c2-cea10b3a108e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:10.965426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5394370-b41d-4b4d-93c2-cea10b3a108e None admin] PATH_INFO: `/v3/services` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:10.966092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5394370-b41d-4b4d-93c2-cea10b3a108e None admin] RBAC: Adding query filter params (type=placement) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:10.966392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5394370-b41d-4b4d-93c2-cea10b3a108e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:10.967835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5394370-b41d-4b4d-93c2-cea10b3a108e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:10.972160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 653/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Aug 22 19:44:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:12.858703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4bf6c-85c9-46ce-869f-99fa6de5e5bc None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:12.859294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4bf6c-85c9-46ce-869f-99fa6de5e5bc None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:12.859415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4bf6c-85c9-46ce-869f-99fa6de5e5bc None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:12.860722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 640/1293] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:44:12.866118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928f60-3709-4e9c-9468-daaf7763edae None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:12.866513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928f60-3709-4e9c-9468-daaf7763edae None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:12.866656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928f60-3709-4e9c-9468-daaf7763edae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:12.885166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-19928f60-3709-4e9c-9468-daaf7763edae None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:44:12.886366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-19928f60-3709-4e9c-9468-daaf7763edae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:44:12.916739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:12.954233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 654/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:44:13.222391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4bf6c-85c9-46ce-869f-99fa6de5e5bc None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:13.254535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:13.325600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4bf6c-85c9-46ce-869f-99fa6de5e5bc None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:13.360257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9d043-e5b1-4f14-88fc-d0d8cd2949f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:13.360856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9d043-e5b1-4f14-88fc-d0d8cd2949f5 None admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:13.361134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9d043-e5b1-4f14-88fc-d0d8cd2949f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:13.361407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9d043-e5b1-4f14-88fc-d0d8cd2949f5 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:13.362053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9d043-e5b1-4f14-88fc-d0d8cd2949f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:13.363450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9d043-e5b1-4f14-88fc-d0d8cd2949f5 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:13.445998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 641/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Aug 22 19:44:13 2022] POST /identity/v3/services => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:44:15.357614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069ef1-75f9-4a02-bf87-a06ec40bea9d None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:15.358207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069ef1-75f9-4a02-bf87-a06ec40bea9d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:15.358207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069ef1-75f9-4a02-bf87-a06ec40bea9d None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:15.359561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 655/1296] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:44:15.364802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5287821-342b-484e-9745-f664122550b5 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:15.365252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5287821-342b-484e-9745-f664122550b5 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:15.365436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5287821-342b-484e-9745-f664122550b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:15.384663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-d5287821-342b-484e-9745-f664122550b5 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:44:15.385838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d5287821-342b-484e-9745-f664122550b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:44:15.462151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 642/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:44:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:44:15.734544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31069ef1-75f9-4a02-bf87-a06ec40bea9d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:15.836173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31069ef1-75f9-4a02-bf87-a06ec40bea9d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:15.870312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8c901-86b2-4e7d-87e3-aed5833b9eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:15.871699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8c901-86b2-4e7d-87e3-aed5833b9eec None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:15.871978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8c901-86b2-4e7d-87e3-aed5833b9eec None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:15.872246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8c901-86b2-4e7d-87e3-aed5833b9eec None admin] PATH_INFO: `/v3/services/placement` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:15.872827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8c901-86b2-4e7d-87e3-aed5833b9eec None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:15.874188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8c901-86b2-4e7d-87e3-aed5833b9eec None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-33d8c901-86b2-4e7d-87e3-aed5833b9eec None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:15.882996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:15.886744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:15.887856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 656/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:44:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:15.890342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5287821-342b-484e-9745-f664122550b5 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:15.909189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:15.990418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5287821-342b-484e-9745-f664122550b5 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:16.025658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be153d44-ec6f-494f-b132-9a84214dbc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:16.026261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153d44-ec6f-494f-b132-9a84214dbc86 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:16.026540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153d44-ec6f-494f-b132-9a84214dbc86 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:16.026815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153d44-ec6f-494f-b132-9a84214dbc86 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:16.028044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be153d44-ec6f-494f-b132-9a84214dbc86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:16.028349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be153d44-ec6f-494f-b132-9a84214dbc86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:16.029719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be153d44-ec6f-494f-b132-9a84214dbc86 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:16.034812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 643/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Aug 22 19:44:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:16.040869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8c901-86b2-4e7d-87e3-aed5833b9eec None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:16.073810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:16.142891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8c901-86b2-4e7d-87e3-aed5833b9eec None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:16.178929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f532c-1c0e-4006-993e-365f3934a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:16.179684 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f532c-1c0e-4006-993e-365f3934a40f None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:16.182869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f532c-1c0e-4006-993e-365f3934a40f None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:16.182869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f532c-1c0e-4006-993e-365f3934a40f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:16.182869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f532c-1c0e-4006-993e-365f3934a40f None admin] RBAC: Adding query filter params (interface=public, service_id=24746020ac234360967f2e4741c833c2, region_id=RegionOne) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:16.182869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f532c-1c0e-4006-993e-365f3934a40f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:16.183323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f532c-1c0e-4006-993e-365f3934a40f None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:16.188406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 657/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Aug 22 19:44:16 2022] GET /identity/v3/endpoints?service_id=24746020ac234360967f2e4741c833c2&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:16.194099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be153d44-ec6f-494f-b132-9a84214dbc86 None admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:16.276851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:16.296331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be153d44-ec6f-494f-b132-9a84214dbc86 None admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:16.332136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f0bec-8d99-4092-a89e-7f5dc34c6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:16.332725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f0bec-8d99-4092-a89e-7f5dc34c6517 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:16.333003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f0bec-8d99-4092-a89e-7f5dc34c6517 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:16.333272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f0bec-8d99-4092-a89e-7f5dc34c6517 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:16.333875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f0bec-8d99-4092-a89e-7f5dc34c6517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:16.335239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f0bec-8d99-4092-a89e-7f5dc34c6517 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:16.342690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 644/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Aug 22 19:44:16 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:44:18.240382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360ea20-1086-4b69-9cdd-8c770cb00a64 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:18.240914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360ea20-1086-4b69-9cdd-8c770cb00a64 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:18.240914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360ea20-1086-4b69-9cdd-8c770cb00a64 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:18.242262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 658/1302] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:44:18.248200 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89bbe-acb0-470a-bc2b-68bd9f98aefb None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:18.248652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89bbe-acb0-470a-bc2b-68bd9f98aefb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:18.248758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89bbe-acb0-470a-bc2b-68bd9f98aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:18.267157 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-d3e89bbe-acb0-470a-bc2b-68bd9f98aefb None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:44:18.268427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d3e89bbe-acb0-470a-bc2b-68bd9f98aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:44:18.337734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 645/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:44:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 19:44:18.607016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360ea20-1086-4b69-9cdd-8c770cb00a64 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:18.705001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:18.711819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360ea20-1086-4b69-9cdd-8c770cb00a64 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:18.745694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1536c-a714-48d7-bbc5-f32985d48d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:18.746329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1536c-a714-48d7-bbc5-f32985d48d24 None admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:18.746635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1536c-a714-48d7-bbc5-f32985d48d24 None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:18.746941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1536c-a714-48d7-bbc5-f32985d48d24 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:18.747581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1536c-a714-48d7-bbc5-f32985d48d24 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:18.748944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1536c-a714-48d7-bbc5-f32985d48d24 None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application [None req-8dd1536c-a714-48d7-bbc5-f32985d48d24 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 19:44:18.757706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 19:44:18.758800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application with Lock( Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self._enter() Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application return self.creator() Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application created_value = creator( Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: ERROR keystone.server.flask.application Aug 22 19:44:18.760117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 659/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Aug 22 19:44:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 19:44:18.765555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e89bbe-acb0-470a-bc2b-68bd9f98aefb None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:18.841224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:18.863313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e89bbe-acb0-470a-bc2b-68bd9f98aefb None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:18.898665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff359fee-ab93-4d1b-97ef-b7d98eaf3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:18.899290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359fee-ab93-4d1b-97ef-b7d98eaf3665 None admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:18.899567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359fee-ab93-4d1b-97ef-b7d98eaf3665 None admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:18.899833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff359fee-ab93-4d1b-97ef-b7d98eaf3665 None admin] PATH_INFO: `/v3/services` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:18.900458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359fee-ab93-4d1b-97ef-b7d98eaf3665 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:44:18.900754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359fee-ab93-4d1b-97ef-b7d98eaf3665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:18.902683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff359fee-ab93-4d1b-97ef-b7d98eaf3665 None admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:18.907795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 646/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Aug 22 19:44:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:44:18.913671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1536c-a714-48d7-bbc5-f32985d48d24 None admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:44:19.013041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1536c-a714-48d7-bbc5-f32985d48d24 None admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:44:19.046502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e93636-aaf0-4e4a-8e7f-89baabf64d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:44:19.047096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e93636-aaf0-4e4a-8e7f-89baabf64d2e None admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:44:19.047407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e93636-aaf0-4e4a-8e7f-89baabf64d2e None admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:44:19.047676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e93636-aaf0-4e4a-8e7f-89baabf64d2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:44:19.048328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e93636-aaf0-4e4a-8e7f-89baabf64d2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:44:19.049694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e93636-aaf0-4e4a-8e7f-89baabf64d2e None admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:44:19.133514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 660/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:44:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:44:28.904737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=30 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:44:29.127261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:31.625238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaca07c-085f-49cd-83a0-fa5b3c1cd1ce None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:31.625882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaca07c-085f-49cd-83a0-fa5b3c1cd1ce None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:31.625882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaca07c-085f-49cd-83a0-fa5b3c1cd1ce None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:31.633173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d174-0858-48dc-ae3f-2836718bdcc0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:31.633735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d174-0858-48dc-ae3f-2836718bdcc0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:31.633735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d174-0858-48dc-ae3f-2836718bdcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:31.638989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 647/1307] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:50:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:50:31.736634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6d70d174-0858-48dc-ae3f-2836718bdcc0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:31.738153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6d70d174-0858-48dc-ae3f-2836718bdcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:31.875650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 661/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:50:32.191889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2b1f6-c275-490a-8b64-71455994799b None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:32.192142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2b1f6-c275-490a-8b64-71455994799b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:32.192416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2b1f6-c275-490a-8b64-71455994799b None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:32.194074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 648/1309] 10.222.0.18 () {54 vars in 965 bytes} [Mon Aug 22 19:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:50:32.201207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba58911-3e6b-4e56-abb8-ba7478d5a149 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:32.201567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba58911-3e6b-4e56-abb8-ba7478d5a149 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:32.201751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba58911-3e6b-4e56-abb8-ba7478d5a149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:32.289089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-2ba58911-3e6b-4e56-abb8-ba7478d5a149 None None] MFA Rules not processed for user `7500529eff574ca6ae3a9a77d72d2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:32.290753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2ba58911-3e6b-4e56-abb8-ba7478d5a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:32.322216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:32.381407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 662/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Aug 22 19:50:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:50:32.391111 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2b1f6-c275-490a-8b64-71455994799b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:50:32.393794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-dfd2b1f6-c275-490a-8b64-71455994799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:32.522681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2b1f6-c275-490a-8b64-71455994799b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:50:32.607711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6efb7-8725-4b10-9b3b-5b6fceb4bbe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:50:32.608520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6efb7-8725-4b10-9b3b-5b6fceb4bbe2 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:32.608883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6efb7-8725-4b10-9b3b-5b6fceb4bbe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:32.609313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6efb7-8725-4b10-9b3b-5b6fceb4bbe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:32.611026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-faf6efb7-8725-4b10-9b3b-5b6fceb4bbe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:32.670591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:32.738185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6efb7-8725-4b10-9b3b-5b6fceb4bbe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:50:32.739920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6efb7-8725-4b10-9b3b-5b6fceb4bbe2 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:50:32.764566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 649/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:50:35.051793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee900d3-bd19-48df-a5b5-d45723ec0cf7 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:35.052348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee900d3-bd19-48df-a5b5-d45723ec0cf7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:35.052348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee900d3-bd19-48df-a5b5-d45723ec0cf7 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:35.053838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 663/1312] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:50:35.059843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a836036-73a8-4d72-a37b-bf7f9ae40fcc None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:35.060256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a836036-73a8-4d72-a37b-bf7f9ae40fcc None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:35.060494 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a836036-73a8-4d72-a37b-bf7f9ae40fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:35.138522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-5a836036-73a8-4d72-a37b-bf7f9ae40fcc None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:35.139795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5a836036-73a8-4d72-a37b-bf7f9ae40fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:35.257715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 650/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:50:35.541948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee900d3-bd19-48df-a5b5-d45723ec0cf7 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:50:35.544041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3ee900d3-bd19-48df-a5b5-d45723ec0cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:35.655892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee900d3-bd19-48df-a5b5-d45723ec0cf7 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:50:35.728958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:35.732210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a4960-7622-4fdf-9f57-707d0c569e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:50:35.732890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4960-7622-4fdf-9f57-707d0c569e8f service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:35.733173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4960-7622-4fdf-9f57-707d0c569e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:35.733445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4960-7622-4fdf-9f57-707d0c569e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:35.735061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e79a4960-7622-4fdf-9f57-707d0c569e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:35.845290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a4960-7622-4fdf-9f57-707d0c569e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:50:35.846659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a4960-7622-4fdf-9f57-707d0c569e8f service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:50:35.865460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 664/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:50:38.283606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702c16-8d46-414f-803a-3e6a5a5ad5bb None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:38.284173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702c16-8d46-414f-803a-3e6a5a5ad5bb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:38.284173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee702c16-8d46-414f-803a-3e6a5a5ad5bb None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:38.285530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 651/1315] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:50:38.291052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91bd33-ef30-4840-b90b-56676a8907c1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:38.291483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91bd33-ef30-4840-b90b-56676a8907c1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:38.291631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91bd33-ef30-4840-b90b-56676a8907c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:38.358426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-fe91bd33-ef30-4840-b90b-56676a8907c1 None None] MFA Rules not processed for user `794a16f8475e4a71ad739f9516b9f0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:38.359818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fe91bd33-ef30-4840-b90b-56676a8907c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:38.413589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:38.459059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 665/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:50:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:50:38.743806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702c16-8d46-414f-803a-3e6a5a5ad5bb None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:50:38.746077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ee702c16-8d46-414f-803a-3e6a5a5ad5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:38.756612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:38.851727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee702c16-8d46-414f-803a-3e6a5a5ad5bb None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:50:38.927038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6617ef0-815a-42ca-aff0-d6aab06887e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:50:38.927676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6617ef0-815a-42ca-aff0-d6aab06887e9 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:38.927951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6617ef0-815a-42ca-aff0-d6aab06887e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:38.928222 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6617ef0-815a-42ca-aff0-d6aab06887e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:38.929830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d6617ef0-815a-42ca-aff0-d6aab06887e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:38.993733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:39.040657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6617ef0-815a-42ca-aff0-d6aab06887e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:50:39.042691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6617ef0-815a-42ca-aff0-d6aab06887e9 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:50:39.061143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 652/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:50:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:50:41.852248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e655cd-a803-468e-a32f-6d8d64e6f3e5 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:41.852787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e655cd-a803-468e-a32f-6d8d64e6f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:41.852787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e655cd-a803-468e-a32f-6d8d64e6f3e5 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:41.854209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 666/1318] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:50:41.859376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1eb8b-6546-4e57-84ca-9357d57283aa None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:41.859783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1eb8b-6546-4e57-84ca-9357d57283aa None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:41.859931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1eb8b-6546-4e57-84ca-9357d57283aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:41.928909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9ee1eb8b-6546-4e57-84ca-9357d57283aa None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:41.930113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9ee1eb8b-6546-4e57-84ca-9357d57283aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:42.027034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 653/1319] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:50:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:50:42.313314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e655cd-a803-468e-a32f-6d8d64e6f3e5 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:50:42.314876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d0e655cd-a803-468e-a32f-6d8d64e6f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:42.419971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e655cd-a803-468e-a32f-6d8d64e6f3e5 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:50:42.493246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6da2-e76f-4256-a0d7-25608b31d582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:50:42.493850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6da2-e76f-4256-a0d7-25608b31d582 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:42.494128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6da2-e76f-4256-a0d7-25608b31d582 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:42.494402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6da2-e76f-4256-a0d7-25608b31d582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:42.496730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-21ab6da2-e76f-4256-a0d7-25608b31d582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:42.504432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:42.605781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6da2-e76f-4256-a0d7-25608b31d582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:50:42.607151 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6da2-e76f-4256-a0d7-25608b31d582 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:50:42.625965 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 667/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:50:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:50:45.554308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b939-b059-4c15-8125-e9ef49fb6e5b None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:45.554841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b939-b059-4c15-8125-e9ef49fb6e5b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:45.554932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b939-b059-4c15-8125-e9ef49fb6e5b None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:45.556418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 654/1321] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:50:45.562373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dc96c-991d-40e9-acc2-4ff974cd9d5f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:45.562831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dc96c-991d-40e9-acc2-4ff974cd9d5f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:45.562925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dc96c-991d-40e9-acc2-4ff974cd9d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:45.630500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f11dc96c-991d-40e9-acc2-4ff974cd9d5f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:45.631741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f11dc96c-991d-40e9-acc2-4ff974cd9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:45.692464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:45.732612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 668/1322] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:50:46.019641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704b939-b059-4c15-8125-e9ef49fb6e5b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:50:46.021179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3704b939-b059-4c15-8125-e9ef49fb6e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:46.041496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:46.130788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704b939-b059-4c15-8125-e9ef49fb6e5b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:50:46.206926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4beac8-c2b9-4902-8343-370c8797b48d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:50:46.207587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4beac8-c2b9-4902-8343-370c8797b48d service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:46.207870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4beac8-c2b9-4902-8343-370c8797b48d service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:46.208141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4beac8-c2b9-4902-8343-370c8797b48d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:46.209756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1d4beac8-c2b9-4902-8343-370c8797b48d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:46.282438 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:46.321869 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4beac8-c2b9-4902-8343-370c8797b48d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:50:46.323344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4beac8-c2b9-4902-8343-370c8797b48d service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:50:46.342357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 655/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:50:48.327544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331685c6-7ec9-41b5-9aa6-665d1270cef9 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:48.328077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331685c6-7ec9-41b5-9aa6-665d1270cef9 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:48.328077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331685c6-7ec9-41b5-9aa6-665d1270cef9 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:48.329737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 669/1324] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:50:48.335511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1e6a2-60ca-4397-8a2c-e6697a470513 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:48.335925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1e6a2-60ca-4397-8a2c-e6697a470513 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:48.336037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1e6a2-60ca-4397-8a2c-e6697a470513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:48.409851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-a0f1e6a2-60ca-4397-8a2c-e6697a470513 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:48.411092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a0f1e6a2-60ca-4397-8a2c-e6697a470513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:48.511870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 656/1325] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:50:48.798314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331685c6-7ec9-41b5-9aa6-665d1270cef9 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:50:48.799914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-331685c6-7ec9-41b5-9aa6-665d1270cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:48.909109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331685c6-7ec9-41b5-9aa6-665d1270cef9 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:50:48.987512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517234c-9604-4d71-8c87-b7b3d9a3164b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:50:48.988032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517234c-9604-4d71-8c87-b7b3d9a3164b service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:48.988316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517234c-9604-4d71-8c87-b7b3d9a3164b service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:48.988619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517234c-9604-4d71-8c87-b7b3d9a3164b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:48.990272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9517234c-9604-4d71-8c87-b7b3d9a3164b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:49.016114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:49.114123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517234c-9604-4d71-8c87-b7b3d9a3164b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:50:49.115629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517234c-9604-4d71-8c87-b7b3d9a3164b service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:50:49.135693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 670/1326] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:50:51.101134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59b4f-1702-4115-a73b-0a5a3d2a8ce8 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:51.101663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59b4f-1702-4115-a73b-0a5a3d2a8ce8 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:51.101663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd59b4f-1702-4115-a73b-0a5a3d2a8ce8 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:51.103007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 657/1327] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:50:51.109358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d66fe0-0d3f-4dec-abba-5beb48f96d7d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:51.109813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d66fe0-0d3f-4dec-abba-5beb48f96d7d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:51.110008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d66fe0-0d3f-4dec-abba-5beb48f96d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:51.182999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e6d66fe0-0d3f-4dec-abba-5beb48f96d7d None None] MFA Rules not processed for user `794a16f8475e4a71ad739f9516b9f0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:51.184522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e6d66fe0-0d3f-4dec-abba-5beb48f96d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:51.258603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:51.293758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 671/1328] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:50:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:50:51.577841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd59b4f-1702-4115-a73b-0a5a3d2a8ce8 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:50:51.579405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9dd59b4f-1702-4115-a73b-0a5a3d2a8ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:51.610553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:51.696699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd59b4f-1702-4115-a73b-0a5a3d2a8ce8 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:50:51.780066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9487dcf-6c62-401c-808f-b9e43ac35522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:50:51.780672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9487dcf-6c62-401c-808f-b9e43ac35522 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:51.780951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9487dcf-6c62-401c-808f-b9e43ac35522 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:51.781218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9487dcf-6c62-401c-808f-b9e43ac35522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:51.782814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a9487dcf-6c62-401c-808f-b9e43ac35522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:51.863668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:51.897581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9487dcf-6c62-401c-808f-b9e43ac35522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:50:51.899002 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9487dcf-6c62-401c-808f-b9e43ac35522 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:50:51.919259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 658/1329] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:50:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:50:54.296368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d52593-3f33-417f-8aa2-c11e312d5473 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:54.296908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d52593-3f33-417f-8aa2-c11e312d5473 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:54.296908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d52593-3f33-417f-8aa2-c11e312d5473 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:54.298395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 672/1330] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:50:54.304489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7771b-a685-41bc-ac25-7da4a050f14c None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:54.304909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7771b-a685-41bc-ac25-7da4a050f14c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:54.305046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7771b-a685-41bc-ac25-7da4a050f14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:54.372025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-d9b7771b-a685-41bc-ac25-7da4a050f14c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:54.373484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d9b7771b-a685-41bc-ac25-7da4a050f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:54.475405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 659/1331] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:50:54.758000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d52593-3f33-417f-8aa2-c11e312d5473 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:50:54.759578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-60d52593-3f33-417f-8aa2-c11e312d5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:54.870579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d52593-3f33-417f-8aa2-c11e312d5473 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:50:54.948392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646bbd4-40c7-4019-a039-1017a971c9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:50:54.948994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646bbd4-40c7-4019-a039-1017a971c9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:54.949269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646bbd4-40c7-4019-a039-1017a971c9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:54.949536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646bbd4-40c7-4019-a039-1017a971c9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:54.951132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5646bbd4-40c7-4019-a039-1017a971c9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:54.977521 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:55.060700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646bbd4-40c7-4019-a039-1017a971c9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:50:55.062033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646bbd4-40c7-4019-a039-1017a971c9b5 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:50:55.079553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 673/1332] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:50:57.068148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd30d7-d43b-44bc-8334-8189d11d4bfd None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:57.068682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd30d7-d43b-44bc-8334-8189d11d4bfd None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:57.068682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd30d7-d43b-44bc-8334-8189d11d4bfd None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:57.070071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 660/1333] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:50:57.076276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814debc0-82bc-4bcf-82b0-7e6c9c0f3746 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:57.076671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814debc0-82bc-4bcf-82b0-7e6c9c0f3746 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:57.076915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814debc0-82bc-4bcf-82b0-7e6c9c0f3746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:57.145160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-814debc0-82bc-4bcf-82b0-7e6c9c0f3746 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:50:57.146398 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-814debc0-82bc-4bcf-82b0-7e6c9c0f3746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:57.224003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:57.246122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 674/1334] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:50:57.541349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd30d7-d43b-44bc-8334-8189d11d4bfd None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:50:57.542884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-84bd30d7-d43b-44bc-8334-8189d11d4bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:57.586993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:57.651811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd30d7-d43b-44bc-8334-8189d11d4bfd None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:50:57.731940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d00634-d5ba-434e-8e1e-0cc9a6f2bc8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:50:57.732544 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00634-d5ba-434e-8e1e-0cc9a6f2bc8b service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:50:57.732824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00634-d5ba-434e-8e1e-0cc9a6f2bc8b service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:50:57.733098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d00634-d5ba-434e-8e1e-0cc9a6f2bc8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:50:57.734714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b6d00634-d5ba-434e-8e1e-0cc9a6f2bc8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:50:57.823653 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:50:57.850528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d00634-d5ba-434e-8e1e-0cc9a6f2bc8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:50:57.852031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d00634-d5ba-434e-8e1e-0cc9a6f2bc8b service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:50:57.870906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 661/1335] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:00.433901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4106e-6584-4cce-8c16-2152c7bbf4bf None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:00.435108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4106e-6584-4cce-8c16-2152c7bbf4bf None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:00.435108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4106e-6584-4cce-8c16-2152c7bbf4bf None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:00.436561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 675/1336] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:00.442847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70bf28-19e1-4355-9d7f-44d88d374ec7 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:00.443457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70bf28-19e1-4355-9d7f-44d88d374ec7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:00.443584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70bf28-19e1-4355-9d7f-44d88d374ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:00.526113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-3c70bf28-19e1-4355-9d7f-44d88d374ec7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:00.527384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3c70bf28-19e1-4355-9d7f-44d88d374ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:00.635273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 662/1337] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:01.022617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d46529-9b0a-4197-b9f3-9c88e023a47d None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:01.023132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d46529-9b0a-4197-b9f3-9c88e023a47d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:01.023668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d46529-9b0a-4197-b9f3-9c88e023a47d None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:01.030121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 676/1338] 10.222.0.18 () {54 vars in 965 bytes} [Mon Aug 22 19:51:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:01.034893 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cb531-cc04-4ff7-93ad-fadc06f7277c None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:01.035173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cb531-cc04-4ff7-93ad-fadc06f7277c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:01.035474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cb531-cc04-4ff7-93ad-fadc06f7277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:01.107876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:01.136251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ad9cb531-cc04-4ff7-93ad-fadc06f7277c None None] MFA Rules not processed for user `7500529eff574ca6ae3a9a77d72d2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:01.141586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ad9cb531-cc04-4ff7-93ad-fadc06f7277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:01.240889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 663/1339] 10.222.0.18 () {58 vars in 1062 bytes} [Mon Aug 22 19:51:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:01.250304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d46529-9b0a-4197-b9f3-9c88e023a47d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:01.251834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a2d46529-9b0a-4197-b9f3-9c88e023a47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:01.361378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d46529-9b0a-4197-b9f3-9c88e023a47d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:01.447663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808e035-eaef-4f58-ab58-df45fbc2b463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:01.448378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808e035-eaef-4f58-ab58-df45fbc2b463 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:01.448537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808e035-eaef-4f58-ab58-df45fbc2b463 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:01.448804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808e035-eaef-4f58-ab58-df45fbc2b463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:01.450622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2808e035-eaef-4f58-ab58-df45fbc2b463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:01.488246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:01.564604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808e035-eaef-4f58-ab58-df45fbc2b463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:01.565978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808e035-eaef-4f58-ab58-df45fbc2b463 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:01.585216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 677/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:06.534892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e16b-0d7d-407b-a936-97ea97ff14f2 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:06.535465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e16b-0d7d-407b-a936-97ea97ff14f2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:06.535465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386e16b-0d7d-407b-a936-97ea97ff14f2 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:06.538502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 664/1341] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:06.545975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea7b3f-7b77-4c24-b12b-f1bcae82f0d9 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:06.546461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea7b3f-7b77-4c24-b12b-f1bcae82f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:06.546556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea7b3f-7b77-4c24-b12b-f1bcae82f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:06.617393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-a5ea7b3f-7b77-4c24-b12b-f1bcae82f0d9 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:06.618626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a5ea7b3f-7b77-4c24-b12b-f1bcae82f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:06.715718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:06.727458 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 678/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:51:07.015493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e16b-0d7d-407b-a936-97ea97ff14f2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:07.017033 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0386e16b-0d7d-407b-a936-97ea97ff14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:07.179307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386e16b-0d7d-407b-a936-97ea97ff14f2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:07.238177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:07.291483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f184f-bbff-45e0-b7cf-1e70baa60709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:07.292093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f184f-bbff-45e0-b7cf-1e70baa60709 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:07.292374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f184f-bbff-45e0-b7cf-1e70baa60709 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:07.292795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f184f-bbff-45e0-b7cf-1e70baa60709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:07.294891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6d2f184f-bbff-45e0-b7cf-1e70baa60709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:07.412365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f184f-bbff-45e0-b7cf-1e70baa60709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:07.413839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f184f-bbff-45e0-b7cf-1e70baa60709 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:07.434464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 665/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:10.477638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d9b4-b516-462d-83a6-63b7c300266b None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:10.478320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d9b4-b516-462d-83a6-63b7c300266b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:10.478320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d9b4-b516-462d-83a6-63b7c300266b None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:10.479738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 679/1344] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:10.485713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf096-fb8c-40c8-86d4-f6b82c571331 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:10.486440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf096-fb8c-40c8-86d4-f6b82c571331 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:10.486735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf096-fb8c-40c8-86d4-f6b82c571331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:10.560182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-233cf096-fb8c-40c8-86d4-f6b82c571331 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:10.561419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-233cf096-fb8c-40c8-86d4-f6b82c571331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:10.581491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:10.672439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 666/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:10.964428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d9b4-b516-462d-83a6-63b7c300266b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:10.967386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-17d7d9b4-b516-462d-83a6-63b7c300266b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:11.084181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d9b4-b516-462d-83a6-63b7c300266b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:11.165032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d266294-e3ee-442f-a276-94d10b243bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:11.165568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266294-e3ee-442f-a276-94d10b243bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:11.165845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266294-e3ee-442f-a276-94d10b243bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:11.166116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266294-e3ee-442f-a276-94d10b243bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:11.167848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2d266294-e3ee-442f-a276-94d10b243bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:11.220034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:11.300455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d266294-e3ee-442f-a276-94d10b243bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:11.302135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d266294-e3ee-442f-a276-94d10b243bd6 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:11.326570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 680/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:15.647561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1319f91-5ffb-4cc3-81ba-e8d75d9f89a7 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:15.648013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1319f91-5ffb-4cc3-81ba-e8d75d9f89a7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:15.648095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1319f91-5ffb-4cc3-81ba-e8d75d9f89a7 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:15.651697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 667/1347] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:15.654980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ed8ef-6d48-4745-86b7-dff0aadb0b64 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:15.655492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ed8ef-6d48-4745-86b7-dff0aadb0b64 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:15.655574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ed8ef-6d48-4745-86b7-dff0aadb0b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:15.740334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-074ed8ef-6d48-4745-86b7-dff0aadb0b64 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:15.742217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-074ed8ef-6d48-4745-86b7-dff0aadb0b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:15.891383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:15.894861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 681/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:16.185275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1319f91-5ffb-4cc3-81ba-e8d75d9f89a7 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:16.186958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a1319f91-5ffb-4cc3-81ba-e8d75d9f89a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:16.307942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1319f91-5ffb-4cc3-81ba-e8d75d9f89a7 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:16.365305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:16.394923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b0a7-e5ed-484f-8033-0a2e446ec32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:16.396047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b0a7-e5ed-484f-8033-0a2e446ec32c service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:16.396673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b0a7-e5ed-484f-8033-0a2e446ec32c service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:16.396964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b0a7-e5ed-484f-8033-0a2e446ec32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:16.399155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3f69b0a7-e5ed-484f-8033-0a2e446ec32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:16.515456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69b0a7-e5ed-484f-8033-0a2e446ec32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:16.516915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69b0a7-e5ed-484f-8033-0a2e446ec32c service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:16.536401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 668/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:51:22.098027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e680ba-d3ff-4acc-aeb2-44f856164c44 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:22.098027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e680ba-d3ff-4acc-aeb2-44f856164c44 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:22.098915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e680ba-d3ff-4acc-aeb2-44f856164c44 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:22.110762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 682/1350] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 19:51:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:22.112626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cc6b9-c4ec-4ba6-b168-55e99282dec9 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:22.112626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cc6b9-c4ec-4ba6-b168-55e99282dec9 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:22.112626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cc6b9-c4ec-4ba6-b168-55e99282dec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:22.286418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0d0cc6b9-c4ec-4ba6-b168-55e99282dec9 None None] MFA Rules not processed for user `1ef51739456e4beb9ae0f107b13d55f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:22.287841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0d0cc6b9-c4ec-4ba6-b168-55e99282dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:22.320357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:22.517779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 669/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 19:51:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:51:26.848660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30ea6-35e9-4908-9550-db9067231504 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:26.849924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30ea6-35e9-4908-9550-db9067231504 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:26.850474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc30ea6-35e9-4908-9550-db9067231504 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:26.852762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 683/1352] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 19:51:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:26.858593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722753-67ac-42a7-ae41-b125dfa37f5b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:26.859044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722753-67ac-42a7-ae41-b125dfa37f5b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:26.859124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722753-67ac-42a7-ae41-b125dfa37f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:26.945086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7d722753-67ac-42a7-ae41-b125dfa37f5b None None] MFA Rules not processed for user `1ef51739456e4beb9ae0f107b13d55f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:26.946305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7d722753-67ac-42a7-ae41-b125dfa37f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:27.026273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:27.067937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 670/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 19:51:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:28.962988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cdba7-bed2-4c88-95e8-6585da929404 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:28.963801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cdba7-bed2-4c88-95e8-6585da929404 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:28.963801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cdba7-bed2-4c88-95e8-6585da929404 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:28.965877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 684/1354] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 19:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:28.972769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811d6a0-4ee4-4207-9aae-bf69730716f6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:28.973311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811d6a0-4ee4-4207-9aae-bf69730716f6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:28.973476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811d6a0-4ee4-4207-9aae-bf69730716f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:29.062004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7811d6a0-4ee4-4207-9aae-bf69730716f6 None None] MFA Rules not processed for user `1ef51739456e4beb9ae0f107b13d55f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:29.063244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7811d6a0-4ee4-4207-9aae-bf69730716f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:29.173327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 671/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 19:51:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:51:32.302237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b110a2-42c7-4709-a57e-dd35995b5217 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:32.303188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b110a2-42c7-4709-a57e-dd35995b5217 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:32.303188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b110a2-42c7-4709-a57e-dd35995b5217 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:32.304144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 685/1356] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:51:32.309985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae4166-f78b-42b9-a90d-a58c384e0a49 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:32.310743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae4166-f78b-42b9-a90d-a58c384e0a49 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:32.310743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae4166-f78b-42b9-a90d-a58c384e0a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:32.356016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:32.398634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-c2ae4166-f78b-42b9-a90d-a58c384e0a49 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:32.401175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c2ae4166-f78b-42b9-a90d-a58c384e0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:32.567349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 672/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:51:33.038883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1392c-8995-4d41-8a22-21126b40303a None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:33.039162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1392c-8995-4d41-8a22-21126b40303a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:33.039772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1392c-8995-4d41-8a22-21126b40303a None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:33.041122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 686/1358] 10.222.0.18 () {54 vars in 962 bytes} [Mon Aug 22 19:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:33.053460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59a63-e621-47b1-b4fe-8a6d8be3a0de None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:33.054216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59a63-e621-47b1-b4fe-8a6d8be3a0de None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:33.054984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b59a63-e621-47b1-b4fe-8a6d8be3a0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:33.141741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-73b59a63-e621-47b1-b4fe-8a6d8be3a0de None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:33.143031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-73b59a63-e621-47b1-b4fe-8a6d8be3a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:33.201485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:33.282736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 673/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Aug 22 19:51:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:33.297682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1392c-8995-4d41-8a22-21126b40303a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:33.299299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f5b1392c-8995-4d41-8a22-21126b40303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:33.483311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1392c-8995-4d41-8a22-21126b40303a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:33.575028 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:33.636956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc411c-a7c6-4c63-a71a-15edf116fafb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:33.642579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc411c-a7c6-4c63-a71a-15edf116fafb service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:33.642579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc411c-a7c6-4c63-a71a-15edf116fafb service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:33.642579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc411c-a7c6-4c63-a71a-15edf116fafb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:33.642579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4cbc411c-a7c6-4c63-a71a-15edf116fafb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:33.739089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc411c-a7c6-4c63-a71a-15edf116fafb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:33.740869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc411c-a7c6-4c63-a71a-15edf116fafb service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:33.763600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 687/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:35.923390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c409-3b88-4d79-9617-604dd57bd789 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:35.923969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c409-3b88-4d79-9617-604dd57bd789 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:35.923969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c409-3b88-4d79-9617-604dd57bd789 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:35.925438 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 674/1361] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:51:35.930829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f17c0-25c4-460d-b7a5-38d575584efa None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:35.931649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f17c0-25c4-460d-b7a5-38d575584efa None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:35.931935 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f17c0-25c4-460d-b7a5-38d575584efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:36.009838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f22f17c0-25c4-460d-b7a5-38d575584efa None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:36.011627 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f22f17c0-25c4-460d-b7a5-38d575584efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:36.054477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:36.126712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 688/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:51:36.423868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c409-3b88-4d79-9617-604dd57bd789 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:36.425555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9165c409-3b88-4d79-9617-604dd57bd789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:36.596055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c409-3b88-4d79-9617-604dd57bd789 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:36.607975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:36.733665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e34660-7c51-4b27-99e6-d6c4f7ea0a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:36.734302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e34660-7c51-4b27-99e6-d6c4f7ea0a79 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:36.734583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e34660-7c51-4b27-99e6-d6c4f7ea0a79 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:36.734860 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e34660-7c51-4b27-99e6-d6c4f7ea0a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:36.736526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-64e34660-7c51-4b27-99e6-d6c4f7ea0a79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:36.846917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e34660-7c51-4b27-99e6-d6c4f7ea0a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:36.848884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e34660-7c51-4b27-99e6-d6c4f7ea0a79 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:36.869432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 675/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:39.410724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a036-1f47-491f-9f19-d43eca685665 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:39.411640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a036-1f47-491f-9f19-d43eca685665 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:39.412084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261a036-1f47-491f-9f19-d43eca685665 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:39.413715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 689/1364] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:39.419748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773432c1-918d-439a-8c65-8e913e8da894 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:39.420244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773432c1-918d-439a-8c65-8e913e8da894 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:39.420506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773432c1-918d-439a-8c65-8e913e8da894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:39.437817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:39.498985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-773432c1-918d-439a-8c65-8e913e8da894 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:39.500830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-773432c1-918d-439a-8c65-8e913e8da894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:39.613651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 676/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:39.915975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ae60-21df-48a3-b3e4-9e5f57896a1c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:39.916389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ae60-21df-48a3-b3e4-9e5f57896a1c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:39.916795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ae60-21df-48a3-b3e4-9e5f57896a1c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:39.919058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 690/1366] 10.222.0.18 () {54 vars in 962 bytes} [Mon Aug 22 19:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:39.924965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309adf9-5cc2-446c-be0f-4f4f02cb1856 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:39.933326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309adf9-5cc2-446c-be0f-4f4f02cb1856 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:39.933326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309adf9-5cc2-446c-be0f-4f4f02cb1856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:40.013816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6309adf9-5cc2-446c-be0f-4f4f02cb1856 None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:40.015435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6309adf9-5cc2-446c-be0f-4f4f02cb1856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:40.056402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:40.150154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 677/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Aug 22 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:40.158583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ae60-21df-48a3-b3e4-9e5f57896a1c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:40.160240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2804ae60-21df-48a3-b3e4-9e5f57896a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:40.327833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ae60-21df-48a3-b3e4-9e5f57896a1c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:40.350690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:40.462078 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3369c62-1314-4e1f-b378-5c4627475669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:40.462784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3369c62-1314-4e1f-b378-5c4627475669 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:40.463057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3369c62-1314-4e1f-b378-5c4627475669 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:40.463261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3369c62-1314-4e1f-b378-5c4627475669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:40.464901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b3369c62-1314-4e1f-b378-5c4627475669 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:40.563138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3369c62-1314-4e1f-b378-5c4627475669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:40.564926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3369c62-1314-4e1f-b378-5c4627475669 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:40.583522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 691/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:40.866126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe83ff-ac51-430f-a0b4-d5549047760e None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:40.866769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe83ff-ac51-430f-a0b4-d5549047760e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:40.866769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe83ff-ac51-430f-a0b4-d5549047760e None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:40.868064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 678/1369] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:40.877309 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eafe9-831b-4417-8786-e1b2c1128ba3 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:40.877594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eafe9-831b-4417-8786-e1b2c1128ba3 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:40.877871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eafe9-831b-4417-8786-e1b2c1128ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:40.920328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:40.966983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8d0eafe9-831b-4417-8786-e1b2c1128ba3 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:40.968505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8d0eafe9-831b-4417-8786-e1b2c1128ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:41.118110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 692/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:41.688870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb17f-b7ac-4073-b025-d7c9e5475dd2 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:41.689355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb17f-b7ac-4073-b025-d7c9e5475dd2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:41.689838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb17f-b7ac-4073-b025-d7c9e5475dd2 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:41.691398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 679/1371] 10.222.0.18 () {54 vars in 964 bytes} [Mon Aug 22 19:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:41.696392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff887fb-5765-4e15-bd0b-94fb3d66269f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:41.696832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff887fb-5765-4e15-bd0b-94fb3d66269f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:41.697009 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff887fb-5765-4e15-bd0b-94fb3d66269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:41.784340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-dff887fb-5765-4e15-bd0b-94fb3d66269f None None] MFA Rules not processed for user `2422c781c74f44ae83e8b094f1728743`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:41.785570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dff887fb-5765-4e15-bd0b-94fb3d66269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:41.847934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:41.882081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 693/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Aug 22 19:51:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:41.892203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbb17f-b7ac-4073-b025-d7c9e5475dd2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:41.893719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9dcbb17f-b7ac-4073-b025-d7c9e5475dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:42.016213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbb17f-b7ac-4073-b025-d7c9e5475dd2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:42.061359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:42.096166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95e52c-3d02-46b5-8b03-398ae68b5bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:42.096770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95e52c-3d02-46b5-8b03-398ae68b5bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:42.097046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95e52c-3d02-46b5-8b03-398ae68b5bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:42.097326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95e52c-3d02-46b5-8b03-398ae68b5bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:42.098902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0b95e52c-3d02-46b5-8b03-398ae68b5bb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:42.228834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95e52c-3d02-46b5-8b03-398ae68b5bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:42.232345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95e52c-3d02-46b5-8b03-398ae68b5bb8 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:42.268771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 680/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:51:42.852630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164e64-a732-45d4-bcab-c5a35e55cba0 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:42.853212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164e64-a732-45d4-bcab-c5a35e55cba0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:42.853312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164e64-a732-45d4-bcab-c5a35e55cba0 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:42.855330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 694/1374] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:42.860970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15be55-eed0-4c26-b975-c748323b7dea None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:42.861328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15be55-eed0-4c26-b975-c748323b7dea None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:42.861670 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15be55-eed0-4c26-b975-c748323b7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:42.933962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-db15be55-eed0-4c26-b975-c748323b7dea None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:42.935187 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-db15be55-eed0-4c26-b975-c748323b7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:42.958118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:43.044404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 681/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:43.334131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164e64-a732-45d4-bcab-c5a35e55cba0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:43.335704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-35164e64-a732-45d4-bcab-c5a35e55cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:43.492590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164e64-a732-45d4-bcab-c5a35e55cba0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:43.544719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:43.607949 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246597e-705c-4d7e-a02c-d5e07a8dc509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:43.608469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246597e-705c-4d7e-a02c-d5e07a8dc509 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:43.608741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246597e-705c-4d7e-a02c-d5e07a8dc509 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:43.609003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246597e-705c-4d7e-a02c-d5e07a8dc509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:43.610584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7246597e-705c-4d7e-a02c-d5e07a8dc509 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:43.702888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246597e-705c-4d7e-a02c-d5e07a8dc509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:43.704523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246597e-705c-4d7e-a02c-d5e07a8dc509 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:43.723372 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 695/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:45.913781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc2fc-4049-415c-be16-4ecaf5d39e2b None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:45.914633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc2fc-4049-415c-be16-4ecaf5d39e2b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:45.915069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc2fc-4049-415c-be16-4ecaf5d39e2b None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:45.918900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 682/1377] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:45.928657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd4c39-7c5e-4c19-908d-3027ee58f3c0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:45.929176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd4c39-7c5e-4c19-908d-3027ee58f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:45.930990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd4c39-7c5e-4c19-908d-3027ee58f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:46.019435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6abd4c39-7c5e-4c19-908d-3027ee58f3c0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:46.020807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6abd4c39-7c5e-4c19-908d-3027ee58f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:46.029107 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:46.143346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 696/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:46.429577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afc2fc-4049-415c-be16-4ecaf5d39e2b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:46.431350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-31afc2fc-4049-415c-be16-4ecaf5d39e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:46.595799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afc2fc-4049-415c-be16-4ecaf5d39e2b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:46.599921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:46.722609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659bdd4-c5ae-430c-b162-6c01ae8601b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:46.723370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659bdd4-c5ae-430c-b162-6c01ae8601b6 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:46.723677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659bdd4-c5ae-430c-b162-6c01ae8601b6 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:46.723957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659bdd4-c5ae-430c-b162-6c01ae8601b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:46.725710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6659bdd4-c5ae-430c-b162-6c01ae8601b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:46.825420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659bdd4-c5ae-430c-b162-6c01ae8601b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:46.827027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659bdd4-c5ae-430c-b162-6c01ae8601b6 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:46.845785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 683/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:48.953169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6130d5f-b740-4d13-8d6d-ae8f242b9263 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:48.953715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6130d5f-b740-4d13-8d6d-ae8f242b9263 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:48.953715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6130d5f-b740-4d13-8d6d-ae8f242b9263 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:48.955040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 697/1380] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:48.960471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4c20-280c-4ba6-9281-95c428815379 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:48.961236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4c20-280c-4ba6-9281-95c428815379 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:48.961663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f4c20-280c-4ba6-9281-95c428815379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:48.974328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:49.036285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-326f4c20-280c-4ba6-9281-95c428815379 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:49.037492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-326f4c20-280c-4ba6-9281-95c428815379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:49.144335 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 684/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:49.437363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6130d5f-b740-4d13-8d6d-ae8f242b9263 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:49.439042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d6130d5f-b740-4d13-8d6d-ae8f242b9263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:49.596715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:49.608934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6130d5f-b740-4d13-8d6d-ae8f242b9263 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:49.737590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42021946-38fc-499d-92d1-cc8fbb78d6c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:49.738191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42021946-38fc-499d-92d1-cc8fbb78d6c6 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:49.738461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42021946-38fc-499d-92d1-cc8fbb78d6c6 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:49.738725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42021946-38fc-499d-92d1-cc8fbb78d6c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:49.740363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-42021946-38fc-499d-92d1-cc8fbb78d6c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:49.830546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42021946-38fc-499d-92d1-cc8fbb78d6c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:49.832216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42021946-38fc-499d-92d1-cc8fbb78d6c6 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:49.843781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:49.852528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 698/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:51.983758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9bcc-2aa4-4bf9-9fa9-db9c09548398 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:51.984352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9bcc-2aa4-4bf9-9fa9-db9c09548398 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:51.984600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9bcc-2aa4-4bf9-9fa9-db9c09548398 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:51.986368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 685/1383] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:51.991893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369219ae-a48c-4b37-a7eb-e614f7631daf None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:51.992433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369219ae-a48c-4b37-a7eb-e614f7631daf None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:51.992433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369219ae-a48c-4b37-a7eb-e614f7631daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:52.065432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-369219ae-a48c-4b37-a7eb-e614f7631daf None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:52.066660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-369219ae-a48c-4b37-a7eb-e614f7631daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:52.183619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 699/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:51:52.480567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9bcc-2aa4-4bf9-9fa9-db9c09548398 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:52.482080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1f1f9bcc-2aa4-4bf9-9fa9-db9c09548398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:52.575667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:52.655954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9bcc-2aa4-4bf9-9fa9-db9c09548398 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:52.813708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d230a26-9bca-46a3-99b2-68127ecb1c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:52.814851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d230a26-9bca-46a3-99b2-68127ecb1c56 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:52.815495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d230a26-9bca-46a3-99b2-68127ecb1c56 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:52.816097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d230a26-9bca-46a3-99b2-68127ecb1c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:52.819993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6d230a26-9bca-46a3-99b2-68127ecb1c56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:52.903328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:52.955343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d230a26-9bca-46a3-99b2-68127ecb1c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:52.957039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d230a26-9bca-46a3-99b2-68127ecb1c56 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:52.976809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 686/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:55.054887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772710e-ab72-4750-8166-adbac64b112c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:55.055483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772710e-ab72-4750-8166-adbac64b112c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:55.055483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772710e-ab72-4750-8166-adbac64b112c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:55.056820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 700/1386] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:51:55.063022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da40d39-fae4-42ad-87af-4ae09aa0d374 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:55.063524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da40d39-fae4-42ad-87af-4ae09aa0d374 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:55.063727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da40d39-fae4-42ad-87af-4ae09aa0d374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:55.164402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8da40d39-fae4-42ad-87af-4ae09aa0d374 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:55.165798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8da40d39-fae4-42ad-87af-4ae09aa0d374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:55.335334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 687/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:55.626919 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772710e-ab72-4750-8166-adbac64b112c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:55.628471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b772710e-ab72-4750-8166-adbac64b112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:55.723413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:55.812612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772710e-ab72-4750-8166-adbac64b112c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:55.950397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e90dc-0308-4c45-8e61-33b3fcfdf12c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:55.951035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e90dc-0308-4c45-8e61-33b3fcfdf12c service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:55.951592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e90dc-0308-4c45-8e61-33b3fcfdf12c service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:55.951592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e90dc-0308-4c45-8e61-33b3fcfdf12c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:55.953796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-795e90dc-0308-4c45-8e61-33b3fcfdf12c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:56.008499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:56.071823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e90dc-0308-4c45-8e61-33b3fcfdf12c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:56.073913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e90dc-0308-4c45-8e61-33b3fcfdf12c service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:56.092939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 701/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:58.009681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b4ef2-7d70-413b-9046-6359016ac9b7 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:58.010486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b4ef2-7d70-413b-9046-6359016ac9b7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:58.010486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b4ef2-7d70-413b-9046-6359016ac9b7 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:58.011916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 688/1389] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:58.017626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92833a70-0041-4e65-8f43-5458aea93471 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:58.018152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92833a70-0041-4e65-8f43-5458aea93471 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:58.018152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92833a70-0041-4e65-8f43-5458aea93471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:58.086884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-92833a70-0041-4e65-8f43-5458aea93471 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:58.091741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-92833a70-0041-4e65-8f43-5458aea93471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:58.168973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97b50-6164-4327-a49e-7df0d79e15c3 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:58.169243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97b50-6164-4327-a49e-7df0d79e15c3 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:58.169511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97b50-6164-4327-a49e-7df0d79e15c3 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:58.171012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 689/1390] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 19:51:58.185208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3072-5ab2-44fe-afce-e54875aebfce None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:58.185513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3072-5ab2-44fe-afce-e54875aebfce None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:58.185764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3072-5ab2-44fe-afce-e54875aebfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:58.196114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 702/1391] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:58.223499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:58.257701 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-393e3072-5ab2-44fe-afce-e54875aebfce None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:58.258920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-393e3072-5ab2-44fe-afce-e54875aebfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:58.358578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 690/1392] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:51:58.493098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c765-f2f6-4ee4-a868-c0e874f92e16 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:58.493385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c765-f2f6-4ee4-a868-c0e874f92e16 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:58.493653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c765-f2f6-4ee4-a868-c0e874f92e16 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:58.496463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 703/1393] 10.222.0.18 () {54 vars in 967 bytes} [Mon Aug 22 19:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:51:58.501661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e5398-467b-4cb9-9e9e-d16ee5f7c6c8 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:58.501946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e5398-467b-4cb9-9e9e-d16ee5f7c6c8 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:58.502244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e5398-467b-4cb9-9e9e-d16ee5f7c6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:58.589780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-490e5398-467b-4cb9-9e9e-d16ee5f7c6c8 None None] MFA Rules not processed for user `4414630bb2da4523906f0b2dee0c4c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:58.591321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-490e5398-467b-4cb9-9e9e-d16ee5f7c6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:58.645153 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:58.663522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53c765-f2f6-4ee4-a868-c0e874f92e16 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:58.663522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ba53c765-f2f6-4ee4-a868-c0e874f92e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:58.678473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 691/1394] 10.222.0.18 () {58 vars in 1064 bytes} [Mon Aug 22 19:51:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:51:58.680545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:58.686787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e5398-467b-4cb9-9e9e-d16ee5f7c6c8 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:51:58.695046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e5398-467b-4cb9-9e9e-d16ee5f7c6c8 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:58.777679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568cc53-3be7-4117-a7ad-c306fb5daafb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4414630bb2da4523906f0b2dee0c4c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:58.778704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568cc53-3be7-4117-a7ad-c306fb5daafb service glance] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:58.778704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568cc53-3be7-4117-a7ad-c306fb5daafb service glance] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:58.778969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568cc53-3be7-4117-a7ad-c306fb5daafb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:58.780514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6568cc53-3be7-4117-a7ad-c306fb5daafb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:58.837394 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53c765-f2f6-4ee4-a868-c0e874f92e16 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:51:58.911178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568cc53-3be7-4117-a7ad-c306fb5daafb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:58.912790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568cc53-3be7-4117-a7ad-c306fb5daafb service glance] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:58.929836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:58.934689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 692/1395] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:51:58.937198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:51:58.966180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44191c08-b358-4c96-b1eb-08aa64f98536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:51:58.966795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44191c08-b358-4c96-b1eb-08aa64f98536 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:58.967074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44191c08-b358-4c96-b1eb-08aa64f98536 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:58.967376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44191c08-b358-4c96-b1eb-08aa64f98536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:58.969036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-44191c08-b358-4c96-b1eb-08aa64f98536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:59.065761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44191c08-b358-4c96-b1eb-08aa64f98536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:51:59.067502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44191c08-b358-4c96-b1eb-08aa64f98536 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:51:59.086628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 704/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:51:59.825333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed13689-378b-480d-a4b1-7ed5e49b54f6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:51:59.825847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed13689-378b-480d-a4b1-7ed5e49b54f6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:51:59.826034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed13689-378b-480d-a4b1-7ed5e49b54f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:51:59.899692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-bed13689-378b-480d-a4b1-7ed5e49b54f6 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:51:59.901556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bed13689-378b-480d-a4b1-7ed5e49b54f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:51:59.991115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 693/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 19:51:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:00.058104 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439a7e7-6303-4ca1-9f3e-b33d3493446c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:00.059689 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439a7e7-6303-4ca1-9f3e-b33d3493446c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:00.060773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439a7e7-6303-4ca1-9f3e-b33d3493446c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:00.071336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 705/1398] 10.222.0.18 () {54 vars in 943 bytes} [Mon Aug 22 19:52:00 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:00.080937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0681-105b-4b4a-9583-e95ea837f0c6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:00.081287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0681-105b-4b4a-9583-e95ea837f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:00.081624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d0681-105b-4b4a-9583-e95ea837f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:00.178182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-2a0d0681-105b-4b4a-9583-e95ea837f0c6 None None] MFA Rules not processed for user `5a1eeb59bfa24e4bb6658aa4bb5f7852`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:00.179842 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2a0d0681-105b-4b4a-9583-e95ea837f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:00.219886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:00.315024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 694/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Mon Aug 22 19:52:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:52:00.326441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439a7e7-6303-4ca1-9f3e-b33d3493446c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:00.328485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e439a7e7-6303-4ca1-9f3e-b33d3493446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:00.460695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:00.511321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439a7e7-6303-4ca1-9f3e-b33d3493446c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:00.642166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586922f0-eaf1-4a63-91e3-3e3edc97bbe2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:00.642765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586922f0-eaf1-4a63-91e3-3e3edc97bbe2 service swift] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:00.643117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586922f0-eaf1-4a63-91e3-3e3edc97bbe2 service swift] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:00.643424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586922f0-eaf1-4a63-91e3-3e3edc97bbe2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:00.645455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-586922f0-eaf1-4a63-91e3-3e3edc97bbe2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:00.743931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586922f0-eaf1-4a63-91e3-3e3edc97bbe2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:00.746869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586922f0-eaf1-4a63-91e3-3e3edc97bbe2 service swift] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:00.750970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:00.756792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 706/1400] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 19:52:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 19:52:01.184024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82b07-1b27-40fd-b9bf-e5ca946bf27b None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:01.184589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82b07-1b27-40fd-b9bf-e5ca946bf27b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:01.184589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82b07-1b27-40fd-b9bf-e5ca946bf27b None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:01.186226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 695/1401] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:01.191363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367cf36-4657-4153-b794-628837dbe6d2 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:01.191844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367cf36-4657-4153-b794-628837dbe6d2 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:01.191938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367cf36-4657-4153-b794-628837dbe6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:01.263163 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-2367cf36-4657-4153-b794-628837dbe6d2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:01.264415 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2367cf36-4657-4153-b794-628837dbe6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:01.372272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 707/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:01.753434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de82b07-1b27-40fd-b9bf-e5ca946bf27b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:01.755338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0de82b07-1b27-40fd-b9bf-e5ca946bf27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:01.948593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de82b07-1b27-40fd-b9bf-e5ca946bf27b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:01.952084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:02.121041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7360ecd-f91c-4ef8-ab35-a34359e0d518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:02.121874 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7360ecd-f91c-4ef8-ab35-a34359e0d518 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:02.122158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7360ecd-f91c-4ef8-ab35-a34359e0d518 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:02.122427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7360ecd-f91c-4ef8-ab35-a34359e0d518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:02.124106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a7360ecd-f91c-4ef8-ab35-a34359e0d518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:02.234725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7360ecd-f91c-4ef8-ab35-a34359e0d518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:02.236326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7360ecd-f91c-4ef8-ab35-a34359e0d518 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:02.258439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 696/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:52:04.445270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b87d3-4972-492f-bffe-1b1d1d06a6bb None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:04.445827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b87d3-4972-492f-bffe-1b1d1d06a6bb None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:04.445827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b87d3-4972-492f-bffe-1b1d1d06a6bb None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:04.447354 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 708/1404] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:04.452894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343d47-5166-4575-8415-54de37cd972e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:04.453308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343d47-5166-4575-8415-54de37cd972e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:04.453465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54343d47-5166-4575-8415-54de37cd972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:04.463452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:04.524755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-54343d47-5166-4575-8415-54de37cd972e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:04.526118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-54343d47-5166-4575-8415-54de37cd972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:04.632475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 697/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:04.931431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b87d3-4972-492f-bffe-1b1d1d06a6bb None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:04.937635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-708b87d3-4972-492f-bffe-1b1d1d06a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:05.032739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:05.112953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b87d3-4972-492f-bffe-1b1d1d06a6bb None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:05.243429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04023b60-7f2e-49ca-a189-329f27b24fb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:05.245167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04023b60-7f2e-49ca-a189-329f27b24fb6 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:05.245986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04023b60-7f2e-49ca-a189-329f27b24fb6 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:05.246451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04023b60-7f2e-49ca-a189-329f27b24fb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:05.248288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-04023b60-7f2e-49ca-a189-329f27b24fb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:05.298727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:05.353808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04023b60-7f2e-49ca-a189-329f27b24fb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:05.355519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04023b60-7f2e-49ca-a189-329f27b24fb6 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:05.376604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 709/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:07.493449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088cbb8-d749-4421-9280-b45818af8301 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:07.494002 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088cbb8-d749-4421-9280-b45818af8301 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:07.494002 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088cbb8-d749-4421-9280-b45818af8301 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:07.496193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 698/1407] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:52:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:07.501428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171586db-b457-487f-a8e2-88722238bc54 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:07.501882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171586db-b457-487f-a8e2-88722238bc54 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:07.501976 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171586db-b457-487f-a8e2-88722238bc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:07.575677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-171586db-b457-487f-a8e2-88722238bc54 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:07.576893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-171586db-b457-487f-a8e2-88722238bc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:07.703273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 710/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:07.996307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088cbb8-d749-4421-9280-b45818af8301 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:07.996307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a088cbb8-d749-4421-9280-b45818af8301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:08.101279 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:08.173145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088cbb8-d749-4421-9280-b45818af8301 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:08.305373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece5582-ef67-447d-93b2-fd67b9c0276c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:08.305919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece5582-ef67-447d-93b2-fd67b9c0276c service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:08.306210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece5582-ef67-447d-93b2-fd67b9c0276c service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:08.306508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece5582-ef67-447d-93b2-fd67b9c0276c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:08.308924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fece5582-ef67-447d-93b2-fd67b9c0276c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:08.364168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:08.425757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece5582-ef67-447d-93b2-fd67b9c0276c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:08.427984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece5582-ef67-447d-93b2-fd67b9c0276c service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:08.452322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 699/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:17.699329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=93 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:18.445936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=24 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:24.385186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38b59-1200-4b97-a838-18f053b6349e None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:24.385758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38b59-1200-4b97-a838-18f053b6349e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:24.385758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38b59-1200-4b97-a838-18f053b6349e None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:24.387260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 711/1410] 10.222.0.18 () {54 vars in 918 bytes} [Mon Aug 22 19:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:24.392803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44861d6-5bab-4f24-b94b-9078f1244add None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:24.393275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44861d6-5bab-4f24-b94b-9078f1244add None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:24.393377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44861d6-5bab-4f24-b94b-9078f1244add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:24.478020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b44861d6-5bab-4f24-b94b-9078f1244add None None] MFA Rules not processed for user `1ef51739456e4beb9ae0f107b13d55f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:24.479307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b44861d6-5bab-4f24-b94b-9078f1244add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:24.601299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 700/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Aug 22 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:24.617869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6e629-3489-4a7b-921d-1dcda1f04d8c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:24.618153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6e629-3489-4a7b-921d-1dcda1f04d8c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:24.618426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6e629-3489-4a7b-921d-1dcda1f04d8c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:24.620193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 712/1412] 10.222.0.18 () {54 vars in 918 bytes} [Mon Aug 22 19:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:24.626126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dd50e-7d68-4318-9cfb-222a221da289 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:24.626413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dd50e-7d68-4318-9cfb-222a221da289 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:24.626687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dd50e-7d68-4318-9cfb-222a221da289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:24.702397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:24.705212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-531dd50e-7d68-4318-9cfb-222a221da289 None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:24.706439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-531dd50e-7d68-4318-9cfb-222a221da289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:24.829629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 701/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Aug 22 19:52:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:52:27.241712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65393716-a67b-4e1e-ab67-f746e55df513 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:27.242252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65393716-a67b-4e1e-ab67-f746e55df513 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:27.242384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65393716-a67b-4e1e-ab67-f746e55df513 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:27.243703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:27.249299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5646a5-b9f1-417d-a3ce-967003cef803 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:27.249743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5646a5-b9f1-417d-a3ce-967003cef803 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:27.249854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5646a5-b9f1-417d-a3ce-967003cef803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:27.316032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-af5646a5-b9f1-417d-a3ce-967003cef803 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:27.317162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-af5646a5-b9f1-417d-a3ce-967003cef803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:27.373362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:27.415741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:27.705823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65393716-a67b-4e1e-ab67-f746e55df513 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:27.707423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-65393716-a67b-4e1e-ab67-f746e55df513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:27.851460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65393716-a67b-4e1e-ab67-f746e55df513 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:27.923690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:27.963991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef2475-f890-4d4f-9a83-e3e45652242a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:27.964625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef2475-f890-4d4f-9a83-e3e45652242a service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:27.965406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef2475-f890-4d4f-9a83-e3e45652242a service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:27.965677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef2475-f890-4d4f-9a83-e3e45652242a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:27.967388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9cef2475-f890-4d4f-9a83-e3e45652242a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:28.055665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef2475-f890-4d4f-9a83-e3e45652242a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:28.057272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef2475-f890-4d4f-9a83-e3e45652242a service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:28.074907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 714/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:28.972201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc3708-23ac-442e-a222-b35e481f58b6 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:28.972810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc3708-23ac-442e-a222-b35e481f58b6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:28.972810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc3708-23ac-442e-a222-b35e481f58b6 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:28.974121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:28.979039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82777414-73d3-47b8-ab36-b5db84819db8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:28.979473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82777414-73d3-47b8-ab36-b5db84819db8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:28.979616 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82777414-73d3-47b8-ab36-b5db84819db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:29.056951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-82777414-73d3-47b8-ab36-b5db84819db8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:29.058161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-82777414-73d3-47b8-ab36-b5db84819db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:29.085455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:29.156857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:29.315302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc3708-23ac-442e-a222-b35e481f58b6 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:29.316790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-54dc3708-23ac-442e-a222-b35e481f58b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:29.464050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc3708-23ac-442e-a222-b35e481f58b6 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:29.504134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:29.578184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820aa09-a37c-4439-9140-4f5f124be13f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:29.578716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820aa09-a37c-4439-9140-4f5f124be13f service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:29.578994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820aa09-a37c-4439-9140-4f5f124be13f service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:29.579289 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820aa09-a37c-4439-9140-4f5f124be13f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:29.580904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d820aa09-a37c-4439-9140-4f5f124be13f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:29.670191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820aa09-a37c-4439-9140-4f5f124be13f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:29.671870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820aa09-a37c-4439-9140-4f5f124be13f service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:29.690479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 704/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:30.577647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0b4f9-1f18-40ee-8857-d9e5fdf545be None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:30.578176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0b4f9-1f18-40ee-8857-d9e5fdf545be None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:30.578176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0b4f9-1f18-40ee-8857-d9e5fdf545be None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:30.579479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:30.584260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86931d2-c520-4a14-9609-05e7c6e23486 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:30.584708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86931d2-c520-4a14-9609-05e7c6e23486 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:30.584817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86931d2-c520-4a14-9609-05e7c6e23486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:30.638839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:30.660368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b86931d2-c520-4a14-9609-05e7c6e23486 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:30.661586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b86931d2-c520-4a14-9609-05e7c6e23486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:30.759368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:30.916197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0b4f9-1f18-40ee-8857-d9e5fdf545be None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:30.917648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-55a0b4f9-1f18-40ee-8857-d9e5fdf545be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:31.065796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0b4f9-1f18-40ee-8857-d9e5fdf545be None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:31.078510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:31.179563 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffce12-bc3a-4e5c-9434-6e720c6835e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:31.180170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffce12-bc3a-4e5c-9434-6e720c6835e9 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:31.180444 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffce12-bc3a-4e5c-9434-6e720c6835e9 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:31.180707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffce12-bc3a-4e5c-9434-6e720c6835e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:31.182285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d3ffce12-bc3a-4e5c-9434-6e720c6835e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:31.271418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffce12-bc3a-4e5c-9434-6e720c6835e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:31.273023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffce12-bc3a-4e5c-9434-6e720c6835e9 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:31.291634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 717/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:32.158102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc928e0-38c2-496a-a99c-612d729e6c5b None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:32.158680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc928e0-38c2-496a-a99c-612d729e6c5b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:32.158680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc928e0-38c2-496a-a99c-612d729e6c5b None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:32.160040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:32.165112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6385af5-d30f-439e-9445-462f12469322 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:32.165523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6385af5-d30f-439e-9445-462f12469322 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:32.165643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6385af5-d30f-439e-9445-462f12469322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:32.186318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:32.250112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-a6385af5-d30f-439e-9445-462f12469322 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:32.251351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a6385af5-d30f-439e-9445-462f12469322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:32.348575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:32.499263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc928e0-38c2-496a-a99c-612d729e6c5b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:32.500759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7bc928e0-38c2-496a-a99c-612d729e6c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:32.610280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:32.646456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc928e0-38c2-496a-a99c-612d729e6c5b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:32.765780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92fe76-4ba0-4230-9771-f6c63865cc2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:32.766309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92fe76-4ba0-4230-9771-f6c63865cc2a service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:32.766585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92fe76-4ba0-4230-9771-f6c63865cc2a service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:32.766850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92fe76-4ba0-4230-9771-f6c63865cc2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:32.768477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6b92fe76-4ba0-4230-9771-f6c63865cc2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:32.847593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:32.861229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92fe76-4ba0-4230-9771-f6c63865cc2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:32.862846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92fe76-4ba0-4230-9771-f6c63865cc2a service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:32.881493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 707/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:33.740196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648ff7-4b9f-4b43-8374-9eb5f607fb97 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:33.740682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648ff7-4b9f-4b43-8374-9eb5f607fb97 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:33.740801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648ff7-4b9f-4b43-8374-9eb5f607fb97 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:33.742115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:33.747213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f422-077a-4d59-8f5f-8eb12472ecd5 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:33.747682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f422-077a-4d59-8f5f-8eb12472ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:33.747781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f422-077a-4d59-8f5f-8eb12472ecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:33.824781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-cd94f422-077a-4d59-8f5f-8eb12472ecd5 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:33.826018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cd94f422-077a-4d59-8f5f-8eb12472ecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:33.925374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:34.077512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648ff7-4b9f-4b43-8374-9eb5f607fb97 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:34.079044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-36648ff7-4b9f-4b43-8374-9eb5f607fb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:34.163757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:34.227048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648ff7-4b9f-4b43-8374-9eb5f607fb97 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:34.339546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13057fc0-0cc0-42a1-bdc8-67d43fb29478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:34.340857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13057fc0-0cc0-42a1-bdc8-67d43fb29478 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:34.341166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13057fc0-0cc0-42a1-bdc8-67d43fb29478 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:34.341441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13057fc0-0cc0-42a1-bdc8-67d43fb29478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:34.343067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-13057fc0-0cc0-42a1-bdc8-67d43fb29478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:34.391555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:34.441971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13057fc0-0cc0-42a1-bdc8-67d43fb29478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:34.443608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13057fc0-0cc0-42a1-bdc8-67d43fb29478 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:34.461923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 720/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:35.344695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81640f-c40d-456c-b6ab-53c592a4a255 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:35.345298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81640f-c40d-456c-b6ab-53c592a4a255 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:35.345298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81640f-c40d-456c-b6ab-53c592a4a255 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:35.346594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:35.351504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dda0b-c59b-416b-96f0-43e648c903a5 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:35.351893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dda0b-c59b-416b-96f0-43e648c903a5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:35.352058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dda0b-c59b-416b-96f0-43e648c903a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:35.429063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c51dda0b-c59b-416b-96f0-43e648c903a5 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:35.430262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c51dda0b-c59b-416b-96f0-43e648c903a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:35.526798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:35.676646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81640f-c40d-456c-b6ab-53c592a4a255 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:35.678211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8f81640f-c40d-456c-b6ab-53c592a4a255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:35.726951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:35.824806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81640f-c40d-456c-b6ab-53c592a4a255 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:35.941344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd196cf3-f0b2-4967-9282-3362d59fb11b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:35.941948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd196cf3-f0b2-4967-9282-3362d59fb11b service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:35.942225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd196cf3-f0b2-4967-9282-3362d59fb11b service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:35.942495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd196cf3-f0b2-4967-9282-3362d59fb11b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:35.944120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fd196cf3-f0b2-4967-9282-3362d59fb11b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:35.951108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:36.035934 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd196cf3-f0b2-4967-9282-3362d59fb11b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:36.037622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd196cf3-f0b2-4967-9282-3362d59fb11b service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:36.055777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 710/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:36.947190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1eb2-6d0b-42d7-adaf-5ca9252f36bf None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:36.947795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1eb2-6d0b-42d7-adaf-5ca9252f36bf None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:36.947795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b1eb2-6d0b-42d7-adaf-5ca9252f36bf None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:36.949145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:36.954740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a347e-865a-4ecc-9b76-34ad3f3b2623 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:36.955178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a347e-865a-4ecc-9b76-34ad3f3b2623 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:36.955314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a347e-865a-4ecc-9b76-34ad3f3b2623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:37.031449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7a5a347e-865a-4ecc-9b76-34ad3f3b2623 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:37.032678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7a5a347e-865a-4ecc-9b76-34ad3f3b2623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:37.100825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:37.129840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:37.278596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1eb2-6d0b-42d7-adaf-5ca9252f36bf None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:37.281139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c59b1eb2-6d0b-42d7-adaf-5ca9252f36bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:37.299434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:37.429852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b1eb2-6d0b-42d7-adaf-5ca9252f36bf None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:37.516506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:37.542107 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbb63f-5ead-4517-8aba-abacd36d04a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:37.542638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbb63f-5ead-4517-8aba-abacd36d04a5 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:37.542908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbb63f-5ead-4517-8aba-abacd36d04a5 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:37.543387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbb63f-5ead-4517-8aba-abacd36d04a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:37.546267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-28cbb63f-5ead-4517-8aba-abacd36d04a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:37.634232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbb63f-5ead-4517-8aba-abacd36d04a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:37.635855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbb63f-5ead-4517-8aba-abacd36d04a5 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:37.654559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 723/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:38.562815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bb5ef-3ee8-40e2-9505-cf49c329ab93 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:38.563428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bb5ef-3ee8-40e2-9505-cf49c329ab93 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:38.563428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bb5ef-3ee8-40e2-9505-cf49c329ab93 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:38.564740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:38.569707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5533b5-ec08-47f8-8aa3-baea72b7f2e5 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:38.570132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5533b5-ec08-47f8-8aa3-baea72b7f2e5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:38.570251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5533b5-ec08-47f8-8aa3-baea72b7f2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:38.645998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-fd5533b5-ec08-47f8-8aa3-baea72b7f2e5 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:38.647256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fd5533b5-ec08-47f8-8aa3-baea72b7f2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:38.689253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:38.746342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:38.896790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bb5ef-3ee8-40e2-9505-cf49c329ab93 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:38.898247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0a1bb5ef-3ee8-40e2-9505-cf49c329ab93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:39.046714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bb5ef-3ee8-40e2-9505-cf49c329ab93 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:39.102012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:39.163044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063af250-9db0-44a2-b391-cbd32d945209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:39.163600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063af250-9db0-44a2-b391-cbd32d945209 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:39.163882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063af250-9db0-44a2-b391-cbd32d945209 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:39.164158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063af250-9db0-44a2-b391-cbd32d945209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:39.165801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-063af250-9db0-44a2-b391-cbd32d945209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:39.257695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063af250-9db0-44a2-b391-cbd32d945209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:39.259345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063af250-9db0-44a2-b391-cbd32d945209 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:39.277987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 713/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:40.147249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188acf13-267e-44bc-ba3d-b07319fda719 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:40.147812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188acf13-267e-44bc-ba3d-b07319fda719 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:40.147812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188acf13-267e-44bc-ba3d-b07319fda719 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:40.149166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:40.154287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660362f3-fff0-4945-a3ea-5f89633b4f88 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:40.154824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660362f3-fff0-4945-a3ea-5f89633b4f88 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:40.154933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660362f3-fff0-4945-a3ea-5f89633b4f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:40.231426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-660362f3-fff0-4945-a3ea-5f89633b4f88 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:40.232863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-660362f3-fff0-4945-a3ea-5f89633b4f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:40.235142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:40.331866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:40.486450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188acf13-267e-44bc-ba3d-b07319fda719 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:40.487933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-188acf13-267e-44bc-ba3d-b07319fda719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:40.633504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188acf13-267e-44bc-ba3d-b07319fda719 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:40.660063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:40.748129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7a1c8-484c-477f-bdca-a6cf94925847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:40.748701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a1c8-484c-477f-bdca-a6cf94925847 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:40.749073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a1c8-484c-477f-bdca-a6cf94925847 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:40.749350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a1c8-484c-477f-bdca-a6cf94925847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:40.750953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-31d7a1c8-484c-477f-bdca-a6cf94925847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:40.844792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7a1c8-484c-477f-bdca-a6cf94925847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:40.846381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7a1c8-484c-477f-bdca-a6cf94925847 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:40.863942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 726/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:42.683640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ce8d-ad35-41d8-9ff4-6218dca5e09d None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:42.684163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ce8d-ad35-41d8-9ff4-6218dca5e09d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:42.684163 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ce8d-ad35-41d8-9ff4-6218dca5e09d None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:42.686284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:42.691891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b07d37-57cf-48f0-a4de-af44da6e2c15 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:42.692355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b07d37-57cf-48f0-a4de-af44da6e2c15 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:42.692460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b07d37-57cf-48f0-a4de-af44da6e2c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:42.735070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:42.761163 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f0b07d37-57cf-48f0-a4de-af44da6e2c15 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:42.762371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f0b07d37-57cf-48f0-a4de-af44da6e2c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:42.864741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:43.152148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ce8d-ad35-41d8-9ff4-6218dca5e09d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:43.154273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d4f6ce8d-ad35-41d8-9ff4-6218dca5e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:43.259635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ce8d-ad35-41d8-9ff4-6218dca5e09d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:43.291450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:43.334107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c00ecf-e98c-47e3-b8dc-4d8c737f8350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:43.334713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c00ecf-e98c-47e3-b8dc-4d8c737f8350 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:43.334996 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c00ecf-e98c-47e3-b8dc-4d8c737f8350 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:43.335336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c00ecf-e98c-47e3-b8dc-4d8c737f8350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:43.337003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c4c00ecf-e98c-47e3-b8dc-4d8c737f8350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:43.446929 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c00ecf-e98c-47e3-b8dc-4d8c737f8350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:43.448408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c00ecf-e98c-47e3-b8dc-4d8c737f8350 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:43.467488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 716/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:45.508329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906ea7a-2b28-473b-ae46-a4faa44cff2e None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:45.508851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906ea7a-2b28-473b-ae46-a4faa44cff2e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:45.508851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906ea7a-2b28-473b-ae46-a4faa44cff2e None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:45.510203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:45.515411 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080e733-296d-4fbd-89ea-f82e8a5d72ff None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:45.515844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080e733-296d-4fbd-89ea-f82e8a5d72ff None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:45.515952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080e733-296d-4fbd-89ea-f82e8a5d72ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:45.581873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6080e733-296d-4fbd-89ea-f82e8a5d72ff None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:45.583074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6080e733-296d-4fbd-89ea-f82e8a5d72ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:45.596160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:45.681861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:45.970174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906ea7a-2b28-473b-ae46-a4faa44cff2e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:45.971744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7906ea7a-2b28-473b-ae46-a4faa44cff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:46.079711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906ea7a-2b28-473b-ae46-a4faa44cff2e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:46.092470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:46.155876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f2372-f1d0-46e8-9445-67cb8968d626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:46.156536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2372-f1d0-46e8-9445-67cb8968d626 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:46.156815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2372-f1d0-46e8-9445-67cb8968d626 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:46.157083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f2372-f1d0-46e8-9445-67cb8968d626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:46.158688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-251f2372-f1d0-46e8-9445-67cb8968d626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:46.271772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f2372-f1d0-46e8-9445-67cb8968d626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:46.273142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f2372-f1d0-46e8-9445-67cb8968d626 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:46.298337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 729/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:48.555624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3269c-99bf-4555-b051-c92236779f72 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:48.556157 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3269c-99bf-4555-b051-c92236779f72 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:48.556157 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3269c-99bf-4555-b051-c92236779f72 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:48.557552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:48.563497 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea29d5-1066-4752-8718-108aa9d8232d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:48.563928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea29d5-1066-4752-8718-108aa9d8232d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:48.564035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea29d5-1066-4752-8718-108aa9d8232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:48.612742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:48.630910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-66ea29d5-1066-4752-8718-108aa9d8232d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:48.632144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-66ea29d5-1066-4752-8718-108aa9d8232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:48.735740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:49.019064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3269c-99bf-4555-b051-c92236779f72 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:49.020738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-08a3269c-99bf-4555-b051-c92236779f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:49.126069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3269c-99bf-4555-b051-c92236779f72 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:49.166543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:49.199573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e6b80-2c9e-442e-bd8f-fa32bdfa67db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:49.200950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e6b80-2c9e-442e-bd8f-fa32bdfa67db service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:49.201306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e6b80-2c9e-442e-bd8f-fa32bdfa67db service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:49.201802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e6b80-2c9e-442e-bd8f-fa32bdfa67db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:49.204084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-290e6b80-2c9e-442e-bd8f-fa32bdfa67db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:49.313339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e6b80-2c9e-442e-bd8f-fa32bdfa67db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:49.314724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e6b80-2c9e-442e-bd8f-fa32bdfa67db service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:49.334859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 719/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:51.350912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe6dca-a33a-4491-af05-cfa90a8ca4d4 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:51.351493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe6dca-a33a-4491-af05-cfa90a8ca4d4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:51.351493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe6dca-a33a-4491-af05-cfa90a8ca4d4 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:51.352874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:51.358364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127167a-87aa-4223-86ae-55bd43ed1e85 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:51.358801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127167a-87aa-4223-86ae-55bd43ed1e85 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:51.358907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127167a-87aa-4223-86ae-55bd43ed1e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:51.542301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-1127167a-87aa-4223-86ae-55bd43ed1e85 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:51.543534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1127167a-87aa-4223-86ae-55bd43ed1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:51.564958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:51.643364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:51.927974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe6dca-a33a-4491-af05-cfa90a8ca4d4 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:51.929677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bafe6dca-a33a-4491-af05-cfa90a8ca4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:52.034226 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe6dca-a33a-4491-af05-cfa90a8ca4d4 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:52.054386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:52.110148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db72aa7-2576-449c-b7fe-c9951467eccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:52.110753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db72aa7-2576-449c-b7fe-c9951467eccf service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:52.111037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db72aa7-2576-449c-b7fe-c9951467eccf service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:52.111338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db72aa7-2576-449c-b7fe-c9951467eccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:52.112964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9db72aa7-2576-449c-b7fe-c9951467eccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:52.237489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db72aa7-2576-449c-b7fe-c9951467eccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:52.238934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db72aa7-2576-449c-b7fe-c9951467eccf service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:52.257073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 732/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:54.363447 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967b0ba-7ccb-4d8e-9bff-ef2901a10a63 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:54.363990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967b0ba-7ccb-4d8e-9bff-ef2901a10a63 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:54.363990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967b0ba-7ccb-4d8e-9bff-ef2901a10a63 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:54.365321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:54.370805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048bc7d-f40c-455c-9e55-dffe34e13d34 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:54.371290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048bc7d-f40c-455c-9e55-dffe34e13d34 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:54.371393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048bc7d-f40c-455c-9e55-dffe34e13d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:54.436362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:54.439013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f048bc7d-f40c-455c-9e55-dffe34e13d34 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:54.440254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f048bc7d-f40c-455c-9e55-dffe34e13d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:54.538713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:54.829815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967b0ba-7ccb-4d8e-9bff-ef2901a10a63 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:54.831408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5967b0ba-7ccb-4d8e-9bff-ef2901a10a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:54.936903 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967b0ba-7ccb-4d8e-9bff-ef2901a10a63 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:54.986513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:55.010897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01cb3c-1765-4a34-b57e-5a22ab78b2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:55.011540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01cb3c-1765-4a34-b57e-5a22ab78b2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:55.011819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01cb3c-1765-4a34-b57e-5a22ab78b2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:55.012090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01cb3c-1765-4a34-b57e-5a22ab78b2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:55.015006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2f01cb3c-1765-4a34-b57e-5a22ab78b2a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:55.126309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01cb3c-1765-4a34-b57e-5a22ab78b2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:55.127948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01cb3c-1765-4a34-b57e-5a22ab78b2a9 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:55.151922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 722/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:57.093379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2a69-1bda-4c71-9188-56b850ce637f None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:57.093946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2a69-1bda-4c71-9188-56b850ce637f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:57.093946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c2a69-1bda-4c71-9188-56b850ce637f None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:57.095311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:57.100665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd788a32-8600-4769-83c2-f19434c2d354 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:57.101099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd788a32-8600-4769-83c2-f19434c2d354 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:57.105282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd788a32-8600-4769-83c2-f19434c2d354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:57.169559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fd788a32-8600-4769-83c2-f19434c2d354 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:57.170754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fd788a32-8600-4769-83c2-f19434c2d354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:57.200649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:57.270179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:52:57.560173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2a69-1bda-4c71-9188-56b850ce637f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:52:57.561777 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ad9c2a69-1bda-4c71-9188-56b850ce637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:57.664999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c2a69-1bda-4c71-9188-56b850ce637f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:52:57.693829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:52:57.739507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d45c1b-fcb9-4f01-b520-77b79a4a449d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:52:57.740117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d45c1b-fcb9-4f01-b520-77b79a4a449d service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:57.740396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d45c1b-fcb9-4f01-b520-77b79a4a449d service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:57.740665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d45c1b-fcb9-4f01-b520-77b79a4a449d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:57.742263 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-71d45c1b-fcb9-4f01-b520-77b79a4a449d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:57.851557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d45c1b-fcb9-4f01-b520-77b79a4a449d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:52:57.852994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d45c1b-fcb9-4f01-b520-77b79a4a449d service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:52:57.872467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 735/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:52:59.912114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc394cb-832f-473f-a5a9-32629d2855b4 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:59.912675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc394cb-832f-473f-a5a9-32629d2855b4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:59.912675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc394cb-832f-473f-a5a9-32629d2855b4 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:59.914009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:52:59.920070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58db16d-e153-4095-85be-ac3c6f48d50b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:52:59.920505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58db16d-e153-4095-85be-ac3c6f48d50b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:52:59.920650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58db16d-e153-4095-85be-ac3c6f48d50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:52:59.987174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b58db16d-e153-4095-85be-ac3c6f48d50b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:52:59.988343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b58db16d-e153-4095-85be-ac3c6f48d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:52:59.996939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:00.085993 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:00.381421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc394cb-832f-473f-a5a9-32629d2855b4 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:00.383004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1cc394cb-832f-473f-a5a9-32629d2855b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:00.489484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc394cb-832f-473f-a5a9-32629d2855b4 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:00.546004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:00.567025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef26f58-f9db-4629-a26c-54d1989a1510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:00.567647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef26f58-f9db-4629-a26c-54d1989a1510 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:00.567955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef26f58-f9db-4629-a26c-54d1989a1510 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:00.568252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef26f58-f9db-4629-a26c-54d1989a1510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:00.569990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6ef26f58-f9db-4629-a26c-54d1989a1510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:00.686245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef26f58-f9db-4629-a26c-54d1989a1510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:00.687767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef26f58-f9db-4629-a26c-54d1989a1510 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:00.708218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 725/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:02.680440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17103b5-c01c-4b8d-a4eb-3185c44c0f7e None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:02.681082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17103b5-c01c-4b8d-a4eb-3185c44c0f7e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:02.681302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17103b5-c01c-4b8d-a4eb-3185c44c0f7e None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:02.683164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:02.692416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357cd9-02d3-40e7-a6c9-b56ad92abe84 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:02.699504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357cd9-02d3-40e7-a6c9-b56ad92abe84 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:02.699504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357cd9-02d3-40e7-a6c9-b56ad92abe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:02.779276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-39357cd9-02d3-40e7-a6c9-b56ad92abe84 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:02.780522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-39357cd9-02d3-40e7-a6c9-b56ad92abe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:02.821439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:02.884994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:03.176503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17103b5-c01c-4b8d-a4eb-3185c44c0f7e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:03.178063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b17103b5-c01c-4b8d-a4eb-3185c44c0f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:03.296807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17103b5-c01c-4b8d-a4eb-3185c44c0f7e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:03.335435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:03.372810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5dd296-1c94-4676-aee9-36b9d8ccb27d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:03.373452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dd296-1c94-4676-aee9-36b9d8ccb27d service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:03.373924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dd296-1c94-4676-aee9-36b9d8ccb27d service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:03.374379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5dd296-1c94-4676-aee9-36b9d8ccb27d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:03.376326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bd5dd296-1c94-4676-aee9-36b9d8ccb27d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:03.486033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dd296-1c94-4676-aee9-36b9d8ccb27d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:03.487519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5dd296-1c94-4676-aee9-36b9d8ccb27d service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:03.625041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 738/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:05.546090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe27fe-a885-4cd8-9dc8-741851e6bd63 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:05.546617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe27fe-a885-4cd8-9dc8-741851e6bd63 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:05.546617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe27fe-a885-4cd8-9dc8-741851e6bd63 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:05.547945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:05.553509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101448d-1e5f-444c-9e35-cb57485db9d1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:05.553918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101448d-1e5f-444c-9e35-cb57485db9d1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:05.554054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101448d-1e5f-444c-9e35-cb57485db9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:05.619245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c101448d-1e5f-444c-9e35-cb57485db9d1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:05.620465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c101448d-1e5f-444c-9e35-cb57485db9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:05.638832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:05.716767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:06.003915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe27fe-a885-4cd8-9dc8-741851e6bd63 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:06.005454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ebbe27fe-a885-4cd8-9dc8-741851e6bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:06.111811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe27fe-a885-4cd8-9dc8-741851e6bd63 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:06.178404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:06.185144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de88191-4794-46ba-89bf-692da1c1b4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:06.185736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de88191-4794-46ba-89bf-692da1c1b4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:06.186010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de88191-4794-46ba-89bf-692da1c1b4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:06.186273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de88191-4794-46ba-89bf-692da1c1b4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:06.187877 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3de88191-4794-46ba-89bf-692da1c1b4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:06.295727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de88191-4794-46ba-89bf-692da1c1b4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:06.297078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de88191-4794-46ba-89bf-692da1c1b4f9 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:06.315468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 728/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:08.251767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ba4a5-7e89-492a-af7f-4fd34287516f None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:08.252378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ba4a5-7e89-492a-af7f-4fd34287516f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:08.252378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ba4a5-7e89-492a-af7f-4fd34287516f None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:08.253684 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:08.259441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90999-0972-41c5-bd4a-1eac54326bb0 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:08.259898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90999-0972-41c5-bd4a-1eac54326bb0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:08.259996 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90999-0972-41c5-bd4a-1eac54326bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:08.327909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8ea90999-0972-41c5-bd4a-1eac54326bb0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:08.329032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8ea90999-0972-41c5-bd4a-1eac54326bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:08.377956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:08.430755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:08.717782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ba4a5-7e89-492a-af7f-4fd34287516f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:08.719361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f75ba4a5-7e89-492a-af7f-4fd34287516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:08.821950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ba4a5-7e89-492a-af7f-4fd34287516f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:08.870776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:08.898126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb91812-4122-470d-8969-ce6db59d441d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:08.898738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91812-4122-470d-8969-ce6db59d441d service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:08.899016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91812-4122-470d-8969-ce6db59d441d service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:08.899323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91812-4122-470d-8969-ce6db59d441d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:08.900933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ccb91812-4122-470d-8969-ce6db59d441d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:09.013873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb91812-4122-470d-8969-ce6db59d441d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:09.015236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb91812-4122-470d-8969-ce6db59d441d service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:09.033453 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 741/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:18.428995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=22 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:19.031179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=66 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:28.478552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483b15-4d3a-4493-897b-91fa544604bb None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:28.479103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483b15-4d3a-4493-897b-91fa544604bb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:28.479103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1483b15-4d3a-4493-897b-91fa544604bb None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:28.480462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 730/1471] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:28.486263 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53138b-e560-41e6-a942-1dfc26acacf7 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:28.486706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53138b-e560-41e6-a942-1dfc26acacf7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:28.486839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53138b-e560-41e6-a942-1dfc26acacf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:28.554299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3e53138b-e560-41e6-a942-1dfc26acacf7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:28.555536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3e53138b-e560-41e6-a942-1dfc26acacf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:28.654892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 742/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:28.952401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069010e-96cc-43fd-bd48-a14b2e67230c None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:28.952678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069010e-96cc-43fd-bd48-a14b2e67230c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:28.952943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069010e-96cc-43fd-bd48-a14b2e67230c None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:28.954299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 731/1473] 10.222.0.18 () {54 vars in 967 bytes} [Mon Aug 22 19:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:28.959286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd115de-82fd-4790-9e2f-e16f9df02098 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:28.959578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd115de-82fd-4790-9e2f-e16f9df02098 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:28.959853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd115de-82fd-4790-9e2f-e16f9df02098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:29.035944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-bdd115de-82fd-4790-9e2f-e16f9df02098 None None] MFA Rules not processed for user `4414630bb2da4523906f0b2dee0c4c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:29.037151 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bdd115de-82fd-4790-9e2f-e16f9df02098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:29.057950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:29.113115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 743/1474] 10.222.0.18 () {58 vars in 1064 bytes} [Mon Aug 22 19:53:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:29.120857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069010e-96cc-43fd-bd48-a14b2e67230c None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:29.123018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6069010e-96cc-43fd-bd48-a14b2e67230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:29.227951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069010e-96cc-43fd-bd48-a14b2e67230c None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:29.301601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4990cad-02e0-46b3-95e1-a594f9a3584d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4414630bb2da4523906f0b2dee0c4c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:29.302199 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990cad-02e0-46b3-95e1-a594f9a3584d service glance] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:29.302471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990cad-02e0-46b3-95e1-a594f9a3584d service glance] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:29.302740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990cad-02e0-46b3-95e1-a594f9a3584d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:29.304348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a4990cad-02e0-46b3-95e1-a594f9a3584d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:29.358704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:29.413414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4990cad-02e0-46b3-95e1-a594f9a3584d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:29.414862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4990cad-02e0-46b3-95e1-a594f9a3584d service glance] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:29.434868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 732/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:31.448492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63017095-b296-4e22-97aa-5ae00b80448a None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:31.449079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63017095-b296-4e22-97aa-5ae00b80448a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:31.449079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63017095-b296-4e22-97aa-5ae00b80448a None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:31.450410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 744/1476] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:31.455952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef78cf-00a8-4f6c-91b6-9cdf3e37c7cc None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:31.456385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef78cf-00a8-4f6c-91b6-9cdf3e37c7cc None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:31.456505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef78cf-00a8-4f6c-91b6-9cdf3e37c7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:31.522786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fdef78cf-00a8-4f6c-91b6-9cdf3e37c7cc None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:31.524006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fdef78cf-00a8-4f6c-91b6-9cdf3e37c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:31.621226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 733/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:31.894322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63017095-b296-4e22-97aa-5ae00b80448a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:31.895937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-63017095-b296-4e22-97aa-5ae00b80448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:32.022219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63017095-b296-4e22-97aa-5ae00b80448a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:32.072541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:32.117584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a910a3-aef1-413b-88cc-f01c59c8d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:32.118432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a910a3-aef1-413b-88cc-f01c59c8d30f admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:32.118709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a910a3-aef1-413b-88cc-f01c59c8d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:32.118974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a910a3-aef1-413b-88cc-f01c59c8d30f admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:32.119653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a910a3-aef1-413b-88cc-f01c59c8d30f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:32.121643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING py.warnings [None req-31a910a3-aef1-413b-88cc-f01c59c8d30f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:53:32.121643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: warnings.warn(msg) Aug 22 19:53:32.121643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: Aug 22 19:53:32.122792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a910a3-aef1-413b-88cc-f01c59c8d30f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:32.141232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 745/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Aug 22 19:53:31 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:53:34.082423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de8d05-2824-42c0-bf5e-8cae9b795a37 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:34.082982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de8d05-2824-42c0-bf5e-8cae9b795a37 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:34.082982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de8d05-2824-42c0-bf5e-8cae9b795a37 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:34.084458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 734/1479] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:34.089686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d3f3-4c76-4b10-aee5-7733b13b047e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:34.090238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d3f3-4c76-4b10-aee5-7733b13b047e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:34.090396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d3f3-4c76-4b10-aee5-7733b13b047e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:34.157179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-5db6d3f3-4c76-4b10-aee5-7733b13b047e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:34.158395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5db6d3f3-4c76-4b10-aee5-7733b13b047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:34.255909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 746/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:34.544409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de8d05-2824-42c0-bf5e-8cae9b795a37 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:34.545907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-77de8d05-2824-42c0-bf5e-8cae9b795a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:34.555779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:34.695450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de8d05-2824-42c0-bf5e-8cae9b795a37 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:34.778552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:34.811271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4121a-6cbe-4ba8-adbf-d493e02b008b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:34.811774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4121a-6cbe-4ba8-adbf-d493e02b008b service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:34.812046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4121a-6cbe-4ba8-adbf-d493e02b008b service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:34.812309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4121a-6cbe-4ba8-adbf-d493e02b008b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:34.813890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9bc4121a-6cbe-4ba8-adbf-d493e02b008b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:34.903855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4121a-6cbe-4ba8-adbf-d493e02b008b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:34.905449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4121a-6cbe-4ba8-adbf-d493e02b008b service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:34.924599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 735/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:37.023985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a59c8-a7b4-4e56-8499-8a9d4b02df25 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:37.024522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a59c8-a7b4-4e56-8499-8a9d4b02df25 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:37.024636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a59c8-a7b4-4e56-8499-8a9d4b02df25 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:37.025911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 747/1482] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:37.031537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e2db-af73-4b16-9678-83fb4e9945a7 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:37.032110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e2db-af73-4b16-9678-83fb4e9945a7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:37.032110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b13e2db-af73-4b16-9678-83fb4e9945a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:37.100001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8b13e2db-af73-4b16-9678-83fb4e9945a7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:37.101212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8b13e2db-af73-4b16-9678-83fb4e9945a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:37.148777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:37.201238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 736/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:37.489920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a59c8-a7b4-4e56-8499-8a9d4b02df25 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:37.491511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-494a59c8-a7b4-4e56-8499-8a9d4b02df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:37.514833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:37.597209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a59c8-a7b4-4e56-8499-8a9d4b02df25 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:37.669790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26641c-91c6-4966-ac6a-5eee06c6f81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:37.670319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26641c-91c6-4966-ac6a-5eee06c6f81f service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:37.670594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26641c-91c6-4966-ac6a-5eee06c6f81f service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:37.670861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26641c-91c6-4966-ac6a-5eee06c6f81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:37.672486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4b26641c-91c6-4966-ac6a-5eee06c6f81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:37.748584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:37.784628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26641c-91c6-4966-ac6a-5eee06c6f81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:37.786068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26641c-91c6-4966-ac6a-5eee06c6f81f service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:37.804528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 748/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:39.747273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf4849-75f8-4ba4-967d-ff93abfb257e None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:39.747804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf4849-75f8-4ba4-967d-ff93abfb257e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:39.747910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf4849-75f8-4ba4-967d-ff93abfb257e None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:39.749210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 737/1485] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:39.754353 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0504be7-f350-4d97-903e-95d5c8490fe1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:39.754789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0504be7-f350-4d97-903e-95d5c8490fe1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:39.754898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0504be7-f350-4d97-903e-95d5c8490fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:39.821754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c0504be7-f350-4d97-903e-95d5c8490fe1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:39.822955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c0504be7-f350-4d97-903e-95d5c8490fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:39.920456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 749/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:53:40.213098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf4849-75f8-4ba4-967d-ff93abfb257e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:40.214632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-25bf4849-75f8-4ba4-967d-ff93abfb257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:40.322717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf4849-75f8-4ba4-967d-ff93abfb257e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:40.395328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:40.397174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259454a-fd89-431c-b53c-d07dbc110792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:40.397779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259454a-fd89-431c-b53c-d07dbc110792 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:40.398052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259454a-fd89-431c-b53c-d07dbc110792 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:40.398317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259454a-fd89-431c-b53c-d07dbc110792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:40.399952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f259454a-fd89-431c-b53c-d07dbc110792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:40.517647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259454a-fd89-431c-b53c-d07dbc110792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:40.519025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259454a-fd89-431c-b53c-d07dbc110792 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:40.537571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 738/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:42.600606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b79a64-6d7f-491d-925d-edf148f64565 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:42.601139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b79a64-6d7f-491d-925d-edf148f64565 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:42.601139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b79a64-6d7f-491d-925d-edf148f64565 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:42.602486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 750/1488] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:42.608146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67a47-f4fc-4f11-afc8-1548dd280378 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:42.608601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67a47-f4fc-4f11-afc8-1548dd280378 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:42.608705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e67a47-f4fc-4f11-afc8-1548dd280378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:42.675440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-20e67a47-f4fc-4f11-afc8-1548dd280378 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:42.676654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-20e67a47-f4fc-4f11-afc8-1548dd280378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:42.733673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:42.777642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 739/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:53:43.079047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b79a64-6d7f-491d-925d-edf148f64565 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:43.080670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-68b79a64-6d7f-491d-925d-edf148f64565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:43.116811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:43.185891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b79a64-6d7f-491d-925d-edf148f64565 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:43.258554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f1c74-654d-43d4-a3fa-eec6fe55d821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:43.259152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f1c74-654d-43d4-a3fa-eec6fe55d821 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:43.259452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f1c74-654d-43d4-a3fa-eec6fe55d821 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:43.259720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f1c74-654d-43d4-a3fa-eec6fe55d821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:43.261312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0d3f1c74-654d-43d4-a3fa-eec6fe55d821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:43.342345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:43.373475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f1c74-654d-43d4-a3fa-eec6fe55d821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:43.375005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f1c74-654d-43d4-a3fa-eec6fe55d821 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:43.393360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 751/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:45.676142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2525-4c66-4aff-bd36-1b047f8910b0 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:45.676691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2525-4c66-4aff-bd36-1b047f8910b0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:45.676691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2525-4c66-4aff-bd36-1b047f8910b0 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:45.678082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 740/1491] 10.222.0.18 () {54 vars in 927 bytes} [Mon Aug 22 19:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:53:45.683293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89380cd6-7be5-4b0a-b8c3-9b5411abddfd None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:45.683716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89380cd6-7be5-4b0a-b8c3-9b5411abddfd None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:45.683833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89380cd6-7be5-4b0a-b8c3-9b5411abddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:45.750543 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-89380cd6-7be5-4b0a-b8c3-9b5411abddfd None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:53:45.751791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-89380cd6-7be5-4b0a-b8c3-9b5411abddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:45.847642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 752/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Aug 22 19:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:53:46.137130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2525-4c66-4aff-bd36-1b047f8910b0 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:53:46.138738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e63a2525-4c66-4aff-bd36-1b047f8910b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:46.244267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2525-4c66-4aff-bd36-1b047f8910b0 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:53:46.316806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5144f-b8bc-4546-8bbf-61be0b91b428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:53:46.317400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5144f-b8bc-4546-8bbf-61be0b91b428 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:53:46.317675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5144f-b8bc-4546-8bbf-61be0b91b428 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:53:46.317938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5144f-b8bc-4546-8bbf-61be0b91b428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:53:46.319549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b5d5144f-b8bc-4546-8bbf-61be0b91b428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:53:46.329785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:46.431118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5144f-b8bc-4546-8bbf-61be0b91b428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:53:46.432613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5144f-b8bc-4546-8bbf-61be0b91b428 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:53:46.450952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 741/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:53:55.845805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=82 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:53:56.448631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=50 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:14.147303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d013c2b-081b-436b-8578-db6c49deb876 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:14.147869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d013c2b-081b-436b-8578-db6c49deb876 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:14.147869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d013c2b-081b-436b-8578-db6c49deb876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:14.221223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3d013c2b-081b-436b-8578-db6c49deb876 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:55:14.222420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3d013c2b-081b-436b-8578-db6c49deb876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:14.319900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 753/1494] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:55:14.328037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89445-ca7e-4a91-85f4-85d145af08de None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:14.328533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89445-ca7e-4a91-85f4-85d145af08de None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:14.328639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e89445-ca7e-4a91-85f4-85d145af08de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:14.405425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-64e89445-ca7e-4a91-85f4-85d145af08de None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:55:14.406568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-64e89445-ca7e-4a91-85f4-85d145af08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:14.504661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 742/1495] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:55:14.509360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d013c2b-081b-436b-8578-db6c49deb876 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:14.510559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3d013c2b-081b-436b-8578-db6c49deb876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:14.522099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d013c2b-081b-436b-8578-db6c49deb876 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:14.583738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:14.617867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:14.618470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:14.618747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:14.619016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:14.619692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:55:14.620090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:14.621098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING py.warnings [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:55:14.621098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: warnings.warn(msg) Aug 22 19:55:14.621098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: Aug 22 19:55:14.621990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:14.633903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 754/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:55:14.641848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e89445-ca7e-4a91-85f4-85d145af08de None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:14.650879 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e89445-ca7e-4a91-85f4-85d145af08de None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:14.712717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:14.748491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:14.749093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:14.749365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:14.749628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:14.750242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:14.752133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WARNING py.warnings [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:55:14.752133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: warnings.warn(msg) Aug 22 19:55:14.752133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: Aug 22 19:55:14.753285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:14.869645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 743/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:55:14 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:55:14.873694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:14.875260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:14.911035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c74f31-b023-4157-8c4b-e2d1e817a2cd admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:15.008682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:15.009384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:15.009699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:15.010017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:15.010784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:15.011900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING py.warnings [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:55:15.011900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: warnings.warn(msg) Aug 22 19:55:15.011900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: Aug 22 19:55:15.013240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:15.127215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 755/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:55:14 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:55:15.131652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:15.133191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:15.196291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5d671-d0e1-4e36-b2bc-32efa2f88aec admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:15.279624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:15.289700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:15.290332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:15.290601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:15.290864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:15.291555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:15.292544 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WARNING py.warnings [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:55:15.292544 dv-cinder-835384-22-smb devstack@keystone.service[93486]: warnings.warn(msg) Aug 22 19:55:15.292544 dv-cinder-835384-22-smb devstack@keystone.service[93486]: Aug 22 19:55:15.293435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:15.305812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 744/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:55:15.309740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:15.311291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:15.323665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b2a4a-068e-4730-843c-b513484bbda3 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:15.350156 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:15.421136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239b408-812f-4d0b-b9de-3e6b7fc21fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:15.421743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239b408-812f-4d0b-b9de-3e6b7fc21fcf admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:15.422020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239b408-812f-4d0b-b9de-3e6b7fc21fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:15.422287 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239b408-812f-4d0b-b9de-3e6b7fc21fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:15.422931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239b408-812f-4d0b-b9de-3e6b7fc21fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:15.423988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING py.warnings [None req-9239b408-812f-4d0b-b9de-3e6b7fc21fcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:55:15.423988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: warnings.warn(msg) Aug 22 19:55:15.423988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: Aug 22 19:55:15.424879 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239b408-812f-4d0b-b9de-3e6b7fc21fcf admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:15.437182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 756/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:55:15.442124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:15.443688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:15.477633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf034a-09a1-4e4f-9cc8-a2d1f21796df admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:15.572983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0e73-b0d8-48b5-bb63-3e84197dd7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:15.573557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0e73-b0d8-48b5-bb63-3e84197dd7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:15.573836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0e73-b0d8-48b5-bb63-3e84197dd7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:15.574105 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0e73-b0d8-48b5-bb63-3e84197dd7b0 admin admin] PATH_INFO: `/v3/projects/a95e12d81b354ceb9030571484239b2b/users/d60ec42379234298a597af3b46f1ed6c/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:15.596182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c0e73-b0d8-48b5-bb63-3e84197dd7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95e12d81b354ceb9030571484239b2b, user_id=d60ec42379234298a597af3b46f1ed6c, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:15.597810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WARNING py.warnings [None req-b18c0e73-b0d8-48b5-bb63-3e84197dd7b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:55:15.597810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: warnings.warn(msg) Aug 22 19:55:15.597810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: Aug 22 19:55:15.599822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c0e73-b0d8-48b5-bb63-3e84197dd7b0 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:15.705846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 745/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:55:15 2022] PUT /identity/v3/projects/a95e12d81b354ceb9030571484239b2b/users/d60ec42379234298a597af3b46f1ed6c/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:55:15.718560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfe431-0c86-4714-98ac-dfcbc0b740b8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:15.718839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfe431-0c86-4714-98ac-dfcbc0b740b8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:15.719102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfe431-0c86-4714-98ac-dfcbc0b740b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:15.779643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-4cbfe431-0c86-4714-98ac-dfcbc0b740b8 None None] MFA Rules not processed for user `d60ec42379234298a597af3b46f1ed6c`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:55:15.780884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4cbfe431-0c86-4714-98ac-dfcbc0b740b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:15.858250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 757/1502] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:55:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:55:15.871719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3d17-e925-4d1f-afbb-b3ce1c27de34 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:15.872000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3d17-e925-4d1f-afbb-b3ce1c27de34 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:15.872270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3d17-e925-4d1f-afbb-b3ce1c27de34 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:15.873602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 746/1503] 10.222.0.18 () {54 vars in 964 bytes} [Mon Aug 22 19:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:55:15.878550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30191dce-412e-409f-bdeb-59a29a8e3236 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:15.878866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30191dce-412e-409f-bdeb-59a29a8e3236 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:15.879141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30191dce-412e-409f-bdeb-59a29a8e3236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:15.910927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:15.957530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-30191dce-412e-409f-bdeb-59a29a8e3236 None None] MFA Rules not processed for user `2422c781c74f44ae83e8b094f1728743`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:55:15.958731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-30191dce-412e-409f-bdeb-59a29a8e3236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:16.036046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 758/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Aug 22 19:55:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:55:16.043742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd3d17-e925-4d1f-afbb-b3ce1c27de34 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:16.045281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-12cd3d17-e925-4d1f-afbb-b3ce1c27de34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:16.095849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:16.151398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd3d17-e925-4d1f-afbb-b3ce1c27de34 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:16.225199 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:16.225798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:16.226071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:16.226337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:16.227987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:16.329788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:16.331349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:16.334978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:16.349278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 747/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:55:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:55:16.395926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27e99-305d-45d0-94fa-bda9c85aaf5f None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:16.396369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27e99-305d-45d0-94fa-bda9c85aaf5f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:16.396369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b27e99-305d-45d0-94fa-bda9c85aaf5f None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:16.397789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 759/1506] 10.222.0.18 () {52 vars in 830 bytes} [Mon Aug 22 19:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:55:16.401521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:16.402717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:16.502029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842787ff-c14c-4a45-a77f-963616180f24 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:16.595925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:16.596550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:16.597578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:16.597900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] PATH_INFO: `/v3/users/d60ec42379234298a597af3b46f1ed6c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:16.610016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60ec42379234298a597af3b46f1ed6c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:16.611042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WARNING py.warnings [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:55:16.611042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: warnings.warn(msg) Aug 22 19:55:16.611042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: Aug 22 19:55:16.612446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:16.622071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:16.816347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60ec42379234298a597af3b46f1ed6c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:16.816775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60ec42379234298a597af3b46f1ed6c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:16.830628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60ec42379234298a597af3b46f1ed6c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:16.898235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60ec42379234298a597af3b46f1ed6c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:16.921491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60ec42379234298a597af3b46f1ed6c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:16.927403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 748/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:55:16 2022] DELETE /identity/v3/users/d60ec42379234298a597af3b46f1ed6c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:55:16.933386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85468963-3dbc-4281-af14-b22e05ca27b8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:16.933776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85468963-3dbc-4281-af14-b22e05ca27b8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:16.934157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85468963-3dbc-4281-af14-b22e05ca27b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:16.992476 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-85468963-3dbc-4281-af14-b22e05ca27b8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:55:16.993701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-85468963-3dbc-4281-af14-b22e05ca27b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:17.069350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:17.082511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 760/1508] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:55:17.092072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:17.093298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:17.196151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ec2e4-f4bb-490d-8bc0-bf42bb4c0d86 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:17.279772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:17.299489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4dafe-8da8-4516-993b-33565207d3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:17.300134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4dafe-8da8-4516-993b-33565207d3fa service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:17.300410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4dafe-8da8-4516-993b-33565207d3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:17.300679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4dafe-8da8-4516-993b-33565207d3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:17.302276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c4c4dafe-8da8-4516-993b-33565207d3fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:17.411928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4dafe-8da8-4516-993b-33565207d3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:17.413388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c4dafe-8da8-4516-993b-33565207d3fa service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:17.431900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 749/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:55:17.929933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85468963-3dbc-4281-af14-b22e05ca27b8 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:55:17.931750 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-85468963-3dbc-4281-af14-b22e05ca27b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:55:17.945429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85468963-3dbc-4281-af14-b22e05ca27b8 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:55:18.046769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:55:18.047434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:55:18.047710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:55:18.047984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] PATH_INFO: `/v3/projects/a95e12d81b354ceb9030571484239b2b` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:55:18.058604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95e12d81b354ceb9030571484239b2b)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:55:18.059657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING py.warnings [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:55:18.059657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: warnings.warn(msg) Aug 22 19:55:18.059657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: Aug 22 19:55:18.060865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:55:18.183304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95e12d81b354ceb9030571484239b2b', 'request_id': 'req-b99b3b13-ca13-4972-a425-7052bc980650'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:18.197788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95e12d81b354ceb9030571484239b2b', 'request_id': 'req-b99b3b13-ca13-4972-a425-7052bc980650'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:18.284146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95e12d81b354ceb9030571484239b2b', 'request_id': 'req-b99b3b13-ca13-4972-a425-7052bc980650'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:18.309530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] The token cache is being invalidate because project a95e12d81b354ceb9030571484239b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:55:18.309812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:18.310375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b99b3b13-ca13-4972-a425-7052bc980650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:55:18.311747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 761/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:55:17 2022] DELETE /identity/v3/projects/a95e12d81b354ceb9030571484239b2b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:55:27.429560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=62 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:55:28.307273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:56:57.997778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6c2b0-647b-46a4-9909-6ee49a84d74d None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:56:57.998397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6c2b0-647b-46a4-9909-6ee49a84d74d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:56:57.998397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6c2b0-647b-46a4-9909-6ee49a84d74d None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:56:57.999829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:56:58.004887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db42847-c8c7-4391-b883-f9a4eda20d8b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:56:58.005350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db42847-c8c7-4391-b883-f9a4eda20d8b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:56:58.005454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db42847-c8c7-4391-b883-f9a4eda20d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:56:58.087118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6db42847-c8c7-4391-b883-f9a4eda20d8b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:56:58.088443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6db42847-c8c7-4391-b883-f9a4eda20d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:56:58.197416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:56:58.354868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6c2b0-647b-46a4-9909-6ee49a84d74d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:56:58.357286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7ff6c2b0-647b-46a4-9909-6ee49a84d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:56:58.479943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6c2b0-647b-46a4-9909-6ee49a84d74d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:56:58.485364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39948fb5-ae46-4d81-bc0d-93e9dc16c4c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:56:58.485965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39948fb5-ae46-4d81-bc0d-93e9dc16c4c0 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:56:58.486242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39948fb5-ae46-4d81-bc0d-93e9dc16c4c0 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:56:58.486511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39948fb5-ae46-4d81-bc0d-93e9dc16c4c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:56:58.495957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39948fb5-ae46-4d81-bc0d-93e9dc16c4c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:56:58.497547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39948fb5-ae46-4d81-bc0d-93e9dc16c4c0 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:56:58.506931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 751/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:56:59.351138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4fc0-fa26-4933-9a42-7f7bf6ad324f None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:56:59.351752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4fc0-fa26-4933-9a42-7f7bf6ad324f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:56:59.351916 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df4fc0-fa26-4933-9a42-7f7bf6ad324f None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:56:59.353453 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:56:59.358512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c5d2-20ea-46b5-baca-28afd5138ce0 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:56:59.358976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c5d2-20ea-46b5-baca-28afd5138ce0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:56:59.359079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c5d2-20ea-46b5-baca-28afd5138ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:56:59.381558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0291c5d2-20ea-46b5-baca-28afd5138ce0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:56:59.382760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0291c5d2-20ea-46b5-baca-28afd5138ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:56:59.392078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:56:59.545160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df4fc0-fa26-4933-9a42-7f7bf6ad324f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:56:59.560341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df4fc0-fa26-4933-9a42-7f7bf6ad324f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:56:59.565787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce8e77-b7cd-4089-8614-f5cf6a44dc3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:56:59.566382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce8e77-b7cd-4089-8614-f5cf6a44dc3f service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:56:59.566659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce8e77-b7cd-4089-8614-f5cf6a44dc3f service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:56:59.566930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce8e77-b7cd-4089-8614-f5cf6a44dc3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:56:59.575935 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce8e77-b7cd-4089-8614-f5cf6a44dc3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:56:59.577527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce8e77-b7cd-4089-8614-f5cf6a44dc3f service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:56:59.587080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 764/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:57:00.748513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a901cf-65aa-4899-99ef-81429bea91ae None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:00.749087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a901cf-65aa-4899-99ef-81429bea91ae None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:00.749087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a901cf-65aa-4899-99ef-81429bea91ae None None] PATH_INFO: `/v3` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:00.750311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 753/1517] 10.222.0.59 () {54 vars in 925 bytes} [Mon Aug 22 19:57:00 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:57:00.756557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10a637-a302-4a22-8d92-b50beed62233 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:00.756951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10a637-a302-4a22-8d92-b50beed62233 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:00.757105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10a637-a302-4a22-8d92-b50beed62233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:00.815774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8a10a637-a302-4a22-8d92-b50beed62233 None None] MFA Rules not processed for user `1ef51739456e4beb9ae0f107b13d55f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:57:00.816970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8a10a637-a302-4a22-8d92-b50beed62233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:00.833215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:00.890345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 765/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Mon Aug 22 19:57:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:57:05.033579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71a33b-937d-4501-a591-8d6fed02d9a3 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:05.034107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71a33b-937d-4501-a591-8d6fed02d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:05.034209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71a33b-937d-4501-a591-8d6fed02d9a3 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:05.035504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 754/1519] 10.222.0.18 () {54 vars in 961 bytes} [Mon Aug 22 19:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:57:05.041202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93ed51-e90b-4583-8bc4-858cf6353d08 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:05.041716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93ed51-e90b-4583-8bc4-858cf6353d08 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:05.041842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93ed51-e90b-4583-8bc4-858cf6353d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:05.061378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-5f93ed51-e90b-4583-8bc4-858cf6353d08 None None] MFA Rules not processed for user `1ef51739456e4beb9ae0f107b13d55f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:57:05.062573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5f93ed51-e90b-4583-8bc4-858cf6353d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:05.071545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 766/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Aug 22 19:57:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:57:05.079044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71a33b-937d-4501-a591-8d6fed02d9a3 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:57:05.093680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71a33b-937d-4501-a591-8d6fed02d9a3 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:57:05.098839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bf4e3-b353-4ec2-a910-4f605d3cb946 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:57:05.099476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bf4e3-b353-4ec2-a910-4f605d3cb946 service placement] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:05.099784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bf4e3-b353-4ec2-a910-4f605d3cb946 service placement] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:05.100055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bf4e3-b353-4ec2-a910-4f605d3cb946 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:05.108755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bf4e3-b353-4ec2-a910-4f605d3cb946 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:57:05.110348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bf4e3-b353-4ec2-a910-4f605d3cb946 service placement] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:57:05.120179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 755/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:57:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:57:10.813565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e5ec6-c197-48ee-9a71-5f9805153d9b None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:10.814164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e5ec6-c197-48ee-9a71-5f9805153d9b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:10.814164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e5ec6-c197-48ee-9a71-5f9805153d9b None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:10.815488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:57:10.820323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a2541-8e21-4259-9588-e03faa888ee4 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:10.820760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a2541-8e21-4259-9588-e03faa888ee4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:10.820900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a2541-8e21-4259-9588-e03faa888ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:10.841025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-526a2541-8e21-4259-9588-e03faa888ee4 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:57:10.842226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-526a2541-8e21-4259-9588-e03faa888ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:10.850121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:57:11.003598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e5ec6-c197-48ee-9a71-5f9805153d9b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:57:11.018169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e5ec6-c197-48ee-9a71-5f9805153d9b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:57:11.023714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0f198-1ad1-4f91-bcb7-67d8cf596c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:57:11.024303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0f198-1ad1-4f91-bcb7-67d8cf596c72 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:11.024577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0f198-1ad1-4f91-bcb7-67d8cf596c72 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:11.024845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0f198-1ad1-4f91-bcb7-67d8cf596c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:11.034048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0f198-1ad1-4f91-bcb7-67d8cf596c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:57:11.035679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0f198-1ad1-4f91-bcb7-67d8cf596c72 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:57:11.046145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 768/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:57:11.875152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cd8ef-d026-45b3-bc05-1334996ebc17 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:11.875668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cd8ef-d026-45b3-bc05-1334996ebc17 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:11.875789 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cd8ef-d026-45b3-bc05-1334996ebc17 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:11.877081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 19:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:57:11.882250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486add03-c656-448e-a399-323082c84bf5 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:11.882656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486add03-c656-448e-a399-323082c84bf5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:11.882793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486add03-c656-448e-a399-323082c84bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:11.903459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-486add03-c656-448e-a399-323082c84bf5 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:57:11.904674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-486add03-c656-448e-a399-323082c84bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:11.912485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 19:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:57:12.066098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cd8ef-d026-45b3-bc05-1334996ebc17 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:57:12.082259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cd8ef-d026-45b3-bc05-1334996ebc17 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:57:12.087925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e065824-16e7-4651-ac25-6f65c1a7254c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:57:12.088514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065824-16e7-4651-ac25-6f65c1a7254c service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:12.088791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065824-16e7-4651-ac25-6f65c1a7254c service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:12.089060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065824-16e7-4651-ac25-6f65c1a7254c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:12.097420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e065824-16e7-4651-ac25-6f65c1a7254c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:57:12.099009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e065824-16e7-4651-ac25-6f65c1a7254c service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:57:12.108530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 758/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:57:16.159286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146485-08d1-4335-84fc-1f1cb1f52c19 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:16.159846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146485-08d1-4335-84fc-1f1cb1f52c19 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:16.159846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3146485-08d1-4335-84fc-1f1cb1f52c19 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:16.161214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:57:16.167016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dc507-6534-4a1b-936f-2feae8736fab None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:16.167515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dc507-6534-4a1b-936f-2feae8736fab None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:16.167624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dc507-6534-4a1b-936f-2feae8736fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:16.187624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-cb1dc507-6534-4a1b-936f-2feae8736fab None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:57:16.188739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cb1dc507-6534-4a1b-936f-2feae8736fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:16.196442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:57:16.490431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3146485-08d1-4335-84fc-1f1cb1f52c19 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:57:16.492162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d3146485-08d1-4335-84fc-1f1cb1f52c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:16.572823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3146485-08d1-4335-84fc-1f1cb1f52c19 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:57:16.577005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4f623-0623-4b27-8fc7-ef9627c7a802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:57:16.577698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4f623-0623-4b27-8fc7-ef9627c7a802 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:16.578032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4f623-0623-4b27-8fc7-ef9627c7a802 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:16.578333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4f623-0623-4b27-8fc7-ef9627c7a802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:16.589372 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4f623-0623-4b27-8fc7-ef9627c7a802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:57:16.590882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4f623-0623-4b27-8fc7-ef9627c7a802 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:57:16.600541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 771/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:57:18.496665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7b86d-3498-4123-9a2c-91dfa3631335 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:18.497231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7b86d-3498-4123-9a2c-91dfa3631335 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:18.497231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7b86d-3498-4123-9a2c-91dfa3631335 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:18.498570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:57:18.503787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd1e94-47ff-4054-bdbe-6131823bf9d8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:18.504250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd1e94-47ff-4054-bdbe-6131823bf9d8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:18.504359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd1e94-47ff-4054-bdbe-6131823bf9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:18.523672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c0cd1e94-47ff-4054-bdbe-6131823bf9d8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:57:18.524887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c0cd1e94-47ff-4054-bdbe-6131823bf9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:18.533028 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:57:18.815976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7b86d-3498-4123-9a2c-91dfa3631335 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:57:18.817684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a5e7b86d-3498-4123-9a2c-91dfa3631335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:18.831027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7b86d-3498-4123-9a2c-91dfa3631335 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:57:18.834581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1ae1d-ffb9-433f-b9c4-8c74f2ddae8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:57:18.835177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1ae1d-ffb9-433f-b9c4-8c74f2ddae8d service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:18.835487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1ae1d-ffb9-433f-b9c4-8c74f2ddae8d service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:18.835756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1ae1d-ffb9-433f-b9c4-8c74f2ddae8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:18.845562 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1ae1d-ffb9-433f-b9c4-8c74f2ddae8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:57:18.847001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1ae1d-ffb9-433f-b9c4-8c74f2ddae8d service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:57:18.856980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 761/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:57:22.325024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb375-5a2a-497f-8c90-1439be5b22bc None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:22.325597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb375-5a2a-497f-8c90-1439be5b22bc None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:22.325597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cb375-5a2a-497f-8c90-1439be5b22bc None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:22.326916 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:57:22.332352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e69fe-1a1e-48f7-ba2f-2a6c1354c406 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:22.332818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e69fe-1a1e-48f7-ba2f-2a6c1354c406 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:22.332917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e69fe-1a1e-48f7-ba2f-2a6c1354c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:22.352797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ac4e69fe-1a1e-48f7-ba2f-2a6c1354c406 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:57:22.354098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ac4e69fe-1a1e-48f7-ba2f-2a6c1354c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:22.362372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:57:22.922603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cb375-5a2a-497f-8c90-1439be5b22bc None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:57:22.924369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-177cb375-5a2a-497f-8c90-1439be5b22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:22.990604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:23.004242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cb375-5a2a-497f-8c90-1439be5b22bc None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:57:23.007820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f5a40-b321-42c4-820c-93bd6861a62b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:57:23.008424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f5a40-b321-42c4-820c-93bd6861a62b service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:23.008700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f5a40-b321-42c4-820c-93bd6861a62b service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:23.008970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f5a40-b321-42c4-820c-93bd6861a62b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:23.018012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f5a40-b321-42c4-820c-93bd6861a62b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:57:23.019425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f5a40-b321-42c4-820c-93bd6861a62b service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:57:23.029423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 774/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:57:24.958158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4244a9-ff3d-49c7-aa91-543b507bdac4 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:24.958741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4244a9-ff3d-49c7-aa91-543b507bdac4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:24.958741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4244a9-ff3d-49c7-aa91-543b507bdac4 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:24.960110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 19:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:57:24.965972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27319c67-fe01-48fc-b2ff-62b4ffc4857a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:24.966427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27319c67-fe01-48fc-b2ff-62b4ffc4857a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:24.966537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27319c67-fe01-48fc-b2ff-62b4ffc4857a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:24.986973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-27319c67-fe01-48fc-b2ff-62b4ffc4857a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:57:24.988208 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-27319c67-fe01-48fc-b2ff-62b4ffc4857a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:24.996150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:57:25.585409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4244a9-ff3d-49c7-aa91-543b507bdac4 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:57:25.587330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0b4244a9-ff3d-49c7-aa91-543b507bdac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:57:25.601134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4244a9-ff3d-49c7-aa91-543b507bdac4 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:57:25.605194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174425e2-74cd-43c8-a027-2c74e3383f97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:57:25.605905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174425e2-74cd-43c8-a027-2c74e3383f97 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:57:25.606223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174425e2-74cd-43c8-a027-2c74e3383f97 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:57:25.606535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174425e2-74cd-43c8-a027-2c74e3383f97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:57:25.617179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174425e2-74cd-43c8-a027-2c74e3383f97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:57:25.618856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174425e2-74cd-43c8-a027-2c74e3383f97 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:57:25.630628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 764/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:57:34.982086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=11 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:57:35.625463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:58:59.592344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefebe-671a-49a9-b3b8-5ee705921f72 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:58:59.593333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefebe-671a-49a9-b3b8-5ee705921f72 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:58:59.593775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefebe-671a-49a9-b3b8-5ee705921f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:58:59.623867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-beeefebe-671a-49a9-b3b8-5ee705921f72 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:58:59.625409 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-beeefebe-671a-49a9-b3b8-5ee705921f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:58:59.638655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 776/1540] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:58:59.649015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb6fcf-dded-4cfd-a936-dcf4beaa6bcf None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:58:59.649602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb6fcf-dded-4cfd-a936-dcf4beaa6bcf None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:58:59.649602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb6fcf-dded-4cfd-a936-dcf4beaa6bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:58:59.685433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e4bb6fcf-dded-4cfd-a936-dcf4beaa6bcf None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:58:59.686762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e4bb6fcf-dded-4cfd-a936-dcf4beaa6bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:58:59.703257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 765/1541] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:58:59.717049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeefebe-671a-49a9-b3b8-5ee705921f72 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:58:59.730712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeefebe-671a-49a9-b3b8-5ee705921f72 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:58:59.737339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b770c-f757-4f1d-9169-8b953fea1ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:58:59.738347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b770c-f757-4f1d-9169-8b953fea1ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:58:59.738847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b770c-f757-4f1d-9169-8b953fea1ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:58:59.739575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b770c-f757-4f1d-9169-8b953fea1ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:58:59.740597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b770c-f757-4f1d-9169-8b953fea1ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:58:59.741129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b770c-f757-4f1d-9169-8b953fea1ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:58:59.742980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b770c-f757-4f1d-9169-8b953fea1ed1 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:58:59.764818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 777/1542] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:58:59.774492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb6fcf-dded-4cfd-a936-dcf4beaa6bcf None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:58:59.789185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb6fcf-dded-4cfd-a936-dcf4beaa6bcf None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:58:59.799960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6361-26e9-4e87-bd62-12707422c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:58:59.800619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6361-26e9-4e87-bd62-12707422c669 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:58:59.800875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6361-26e9-4e87-bd62-12707422c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:58:59.801151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6361-26e9-4e87-bd62-12707422c669 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:58:59.802003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e6361-26e9-4e87-bd62-12707422c669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:58:59.804379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e6361-26e9-4e87-bd62-12707422c669 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:58:59.890347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588668ef-4cbc-416a-9ae3-6f80fba5ad5b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:58:59.890940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588668ef-4cbc-416a-9ae3-6f80fba5ad5b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:58:59.891483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588668ef-4cbc-416a-9ae3-6f80fba5ad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:58:59.926820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-588668ef-4cbc-416a-9ae3-6f80fba5ad5b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:58:59.928698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-588668ef-4cbc-416a-9ae3-6f80fba5ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:58:59.945240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 778/1543] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:58:59.948350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70573af4-664d-4d15-9b21-2eb8874e1309 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:58:59.948633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70573af4-664d-4d15-9b21-2eb8874e1309 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:58:59.948908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70573af4-664d-4d15-9b21-2eb8874e1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:58:59.953526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 766/1544] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:58:59 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:58:59.955103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100a52c-f535-4c90-b426-a1028ab2208b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:58:59.955661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100a52c-f535-4c90-b426-a1028ab2208b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:58:59.956392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100a52c-f535-4c90-b426-a1028ab2208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:58:59.979736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-70573af4-664d-4d15-9b21-2eb8874e1309 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:58:59.980962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-70573af4-664d-4d15-9b21-2eb8874e1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:58:59.990286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-a100a52c-f535-4c90-b426-a1028ab2208b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:58:59.991745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a100a52c-f535-4c90-b426-a1028ab2208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.053100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 779/1545] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.054800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70573af4-664d-4d15-9b21-2eb8874e1309 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.066200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70573af4-664d-4d15-9b21-2eb8874e1309 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.069496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 767/1546] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.070907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532891a-2c63-4935-af37-c0690080c188 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.071186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532891a-2c63-4935-af37-c0690080c188 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.071481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532891a-2c63-4935-af37-c0690080c188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.076194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1d2f2-faa6-46eb-8994-4ac8ac5f63a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.076833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1d2f2-faa6-46eb-8994-4ac8ac5f63a3 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.077340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1d2f2-faa6-46eb-8994-4ac8ac5f63a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.077705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1d2f2-faa6-46eb-8994-4ac8ac5f63a3 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.078347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1d2f2-faa6-46eb-8994-4ac8ac5f63a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.080340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1d2f2-faa6-46eb-8994-4ac8ac5f63a3 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.091855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-2532891a-2c63-4935-af37-c0690080c188 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.093293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2532891a-2c63-4935-af37-c0690080c188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.102046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 768/1547] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.105150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec17e98-5923-4d2e-a192-a0de25e03155 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.105150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec17e98-5923-4d2e-a192-a0de25e03155 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.105150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec17e98-5923-4d2e-a192-a0de25e03155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.123089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9ec17e98-5923-4d2e-a192-a0de25e03155 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.124283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9ec17e98-5923-4d2e-a192-a0de25e03155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.132172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 769/1548] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.133444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21737154-eca0-420a-baf4-b21c6bce1ce6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.133726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21737154-eca0-420a-baf4-b21c6bce1ce6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.133994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21737154-eca0-420a-baf4-b21c6bce1ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.153035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-21737154-eca0-420a-baf4-b21c6bce1ce6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.154209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-21737154-eca0-420a-baf4-b21c6bce1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.162643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 770/1549] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.163921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd0a7-edb1-4eba-b832-37586878f09e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.164206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd0a7-edb1-4eba-b832-37586878f09e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.164478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd0a7-edb1-4eba-b832-37586878f09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.168024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 780/1550] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:00.168024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62626ff5-962d-4108-b931-2ce34535c089 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.168024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62626ff5-962d-4108-b931-2ce34535c089 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.168024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62626ff5-962d-4108-b931-2ce34535c089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.186166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-278dd0a7-edb1-4eba-b832-37586878f09e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.186391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-62626ff5-962d-4108-b931-2ce34535c089 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.187405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-62626ff5-962d-4108-b931-2ce34535c089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.187535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-278dd0a7-edb1-4eba-b832-37586878f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.195657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 781/1551] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.196311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 771/1552] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.197306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3724a-d686-4c05-b51d-0ee45aa4ca7b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.197595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3724a-d686-4c05-b51d-0ee45aa4ca7b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.197872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3724a-d686-4c05-b51d-0ee45aa4ca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.203983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92aca8c-df18-44b5-83f0-632e06d34bea None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.204292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92aca8c-df18-44b5-83f0-632e06d34bea None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.204546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92aca8c-df18-44b5-83f0-632e06d34bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.218760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-32c3724a-d686-4c05-b51d-0ee45aa4ca7b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.220011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-32c3724a-d686-4c05-b51d-0ee45aa4ca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.224882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d92aca8c-df18-44b5-83f0-632e06d34bea None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.226129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d92aca8c-df18-44b5-83f0-632e06d34bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.228879 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 772/1553] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.229685 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3724a-d686-4c05-b51d-0ee45aa4ca7b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.237036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 782/1554] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.238246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d62e3c-7be3-4fda-aec3-88d2b47a97f8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.238531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d62e3c-7be3-4fda-aec3-88d2b47a97f8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.238804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d62e3c-7be3-4fda-aec3-88d2b47a97f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.239526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3724a-d686-4c05-b51d-0ee45aa4ca7b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.244405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.245048 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.245402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.245609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.246247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:00.246545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.247577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WARNING py.warnings [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:59:00.247577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: warnings.warn(msg) Aug 22 19:59:00.247577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: Aug 22 19:59:00.248487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.258705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-58d62e3c-7be3-4fda-aec3-88d2b47a97f8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.259953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-58d62e3c-7be3-4fda-aec3-88d2b47a97f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.260586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 773/1555] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:00.261448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.268724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 783/1556] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.271139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580678ca-eb0b-487f-8ea5-af8c5c727a3a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.271474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580678ca-eb0b-487f-8ea5-af8c5c727a3a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.271741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580678ca-eb0b-487f-8ea5-af8c5c727a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.272251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4e6e8-f4d1-4af3-9fc7-2bed57ce1049 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.276957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ad565-49ce-41be-8676-d5ece594cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.277546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ad565-49ce-41be-8676-d5ece594cfef admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.277824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ad565-49ce-41be-8676-d5ece594cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.278093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ad565-49ce-41be-8676-d5ece594cfef admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.278732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ad565-49ce-41be-8676-d5ece594cfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.280344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ad565-49ce-41be-8676-d5ece594cfef admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.291499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 774/1557] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:00.291806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-580678ca-eb0b-487f-8ea5-af8c5c727a3a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.292854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfccab3-1429-46b2-920f-fd1667ffa17e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.293093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-580678ca-eb0b-487f-8ea5-af8c5c727a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.293226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfccab3-1429-46b2-920f-fd1667ffa17e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.293394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfccab3-1429-46b2-920f-fd1667ffa17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.301342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 784/1558] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.302873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419770c-3dbb-432c-8554-314cf4777604 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.303154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419770c-3dbb-432c-8554-314cf4777604 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.303510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419770c-3dbb-432c-8554-314cf4777604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.318328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4dfccab3-1429-46b2-920f-fd1667ffa17e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.319583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4dfccab3-1429-46b2-920f-fd1667ffa17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.323024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8419770c-3dbb-432c-8554-314cf4777604 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:00.324211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8419770c-3dbb-432c-8554-314cf4777604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:00.327782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 775/1559] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.328642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfccab3-1429-46b2-920f-fd1667ffa17e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.332392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 785/1560] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:00.333750 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419770c-3dbb-432c-8554-314cf4777604 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.341648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfccab3-1429-46b2-920f-fd1667ffa17e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.343114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419770c-3dbb-432c-8554-314cf4777604 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.346454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11f99b-7710-4eda-a51f-0833f771b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.347145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11f99b-7710-4eda-a51f-0833f771b785 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.347534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11f99b-7710-4eda-a51f-0833f771b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.347767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6285d-8152-48f2-843f-7341209a0001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.347894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11f99b-7710-4eda-a51f-0833f771b785 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.348340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6285d-8152-48f2-843f-7341209a0001 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.349070 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11f99b-7710-4eda-a51f-0833f771b785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:00.349297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11f99b-7710-4eda-a51f-0833f771b785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.349411 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6285d-8152-48f2-843f-7341209a0001 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.349710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6285d-8152-48f2-843f-7341209a0001 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.350357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6285d-8152-48f2-843f-7341209a0001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:00.350657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6285d-8152-48f2-843f-7341209a0001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.350900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de11f99b-7710-4eda-a51f-0833f771b785 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.352264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6285d-8152-48f2-843f-7341209a0001 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.367706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 776/1561] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:00.367706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11f99b-7710-4eda-a51f-0833f771b785 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.367991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 786/1562] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:00.367991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6285d-8152-48f2-843f-7341209a0001 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.378477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11f99b-7710-4eda-a51f-0833f771b785 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.378648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6285d-8152-48f2-843f-7341209a0001 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.383798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea61e04-91de-4b32-a1a2-06a3096f1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.384050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f00ce3-b725-488e-b17d-79c53b2a8784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.384396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea61e04-91de-4b32-a1a2-06a3096f1528 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.384646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f00ce3-b725-488e-b17d-79c53b2a8784 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.384751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea61e04-91de-4b32-a1a2-06a3096f1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.384922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f00ce3-b725-488e-b17d-79c53b2a8784 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.385030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea61e04-91de-4b32-a1a2-06a3096f1528 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.385193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f00ce3-b725-488e-b17d-79c53b2a8784 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.385540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea61e04-91de-4b32-a1a2-06a3096f1528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.385927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f00ce3-b725-488e-b17d-79c53b2a8784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:00.386232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f00ce3-b725-488e-b17d-79c53b2a8784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.387554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea61e04-91de-4b32-a1a2-06a3096f1528 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.387874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f00ce3-b725-488e-b17d-79c53b2a8784 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.403310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 787/1563] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:00.404239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f00ce3-b725-488e-b17d-79c53b2a8784 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.415436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f00ce3-b725-488e-b17d-79c53b2a8784 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.420083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920479a-0084-4572-b547-eea0950809bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.425328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920479a-0084-4572-b547-eea0950809bf admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.425328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920479a-0084-4572-b547-eea0950809bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.425328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920479a-0084-4572-b547-eea0950809bf admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.425328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920479a-0084-4572-b547-eea0950809bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.425328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920479a-0084-4572-b547-eea0950809bf admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.433984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 788/1564] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:00.434886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920479a-0084-4572-b547-eea0950809bf admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.447736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920479a-0084-4572-b547-eea0950809bf admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.449462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ada30-e57a-4ff2-ae5e-b650491d95bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.450020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ada30-e57a-4ff2-ae5e-b650491d95bd admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.450292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ada30-e57a-4ff2-ae5e-b650491d95bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.450557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ada30-e57a-4ff2-ae5e-b650491d95bd admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.451176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ada30-e57a-4ff2-ae5e-b650491d95bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:00.451510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ada30-e57a-4ff2-ae5e-b650491d95bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.453105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ada30-e57a-4ff2-ae5e-b650491d95bd admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.465419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 789/1565] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:00.470812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ada30-e57a-4ff2-ae5e-b650491d95bd admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.475696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ada30-e57a-4ff2-ae5e-b650491d95bd admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.480215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a4764-5dd7-4f86-a661-0b770a72f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.480785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a4764-5dd7-4f86-a661-0b770a72f1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.481125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a4764-5dd7-4f86-a661-0b770a72f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.481390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a4764-5dd7-4f86-a661-0b770a72f1a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.482017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a4764-5dd7-4f86-a661-0b770a72f1a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:00.482314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a4764-5dd7-4f86-a661-0b770a72f1a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.483922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a4764-5dd7-4f86-a661-0b770a72f1a5 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.492112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 777/1566] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:00.492112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea61e04-91de-4b32-a1a2-06a3096f1528 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.498939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 790/1567] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:00.498939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a4764-5dd7-4f86-a661-0b770a72f1a5 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.509810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a4764-5dd7-4f86-a661-0b770a72f1a5 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.527501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:00.527847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:00.562145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea61e04-91de-4b32-a1a2-06a3096f1528 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.566549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c173ec9-e163-4949-b8e7-0ea8f144026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.566910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d82ec5-ee43-43e2-9fbb-10077b2cd042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.567806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c173ec9-e163-4949-b8e7-0ea8f144026a admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.568197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c173ec9-e163-4949-b8e7-0ea8f144026a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.568692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82ec5-ee43-43e2-9fbb-10077b2cd042 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.568908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c173ec9-e163-4949-b8e7-0ea8f144026a admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.568997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82ec5-ee43-43e2-9fbb-10077b2cd042 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.569253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82ec5-ee43-43e2-9fbb-10077b2cd042 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.569697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c173ec9-e163-4949-b8e7-0ea8f144026a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.569915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d82ec5-ee43-43e2-9fbb-10077b2cd042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:00.570334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d82ec5-ee43-43e2-9fbb-10077b2cd042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.571488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING py.warnings [None req-6c173ec9-e163-4949-b8e7-0ea8f144026a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:59:00.571488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: warnings.warn(msg) Aug 22 19:59:00.571488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: Aug 22 19:59:00.572164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d82ec5-ee43-43e2-9fbb-10077b2cd042 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.572698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c173ec9-e163-4949-b8e7-0ea8f144026a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.584767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 778/1568] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:00.585898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d82ec5-ee43-43e2-9fbb-10077b2cd042 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.602498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d82ec5-ee43-43e2-9fbb-10077b2cd042 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.607271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ce5ed-e25b-44f5-aa6b-f875fee16237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.613894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ce5ed-e25b-44f5-aa6b-f875fee16237 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.613894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ce5ed-e25b-44f5-aa6b-f875fee16237 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.613894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ce5ed-e25b-44f5-aa6b-f875fee16237 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.613894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ce5ed-e25b-44f5-aa6b-f875fee16237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.613894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ce5ed-e25b-44f5-aa6b-f875fee16237 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.650408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 791/1569] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:00.651303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c173ec9-e163-4949-b8e7-0ea8f144026a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.687666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 779/1570] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:00.687666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ce5ed-e25b-44f5-aa6b-f875fee16237 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.718772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c173ec9-e163-4949-b8e7-0ea8f144026a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.750180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ce5ed-e25b-44f5-aa6b-f875fee16237 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.755394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf30c4d-55c5-4c95-9e18-44f43b658dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.756060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf30c4d-55c5-4c95-9e18-44f43b658dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.756346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf30c4d-55c5-4c95-9e18-44f43b658dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.756604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf30c4d-55c5-4c95-9e18-44f43b658dc6 admin admin] PATH_INFO: `/v3/projects/15ef85feac4d4101aafc6de33c5e5f25/users/d1cf2319fc444dc3ba53ed58b3cf8a63/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.771034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf30c4d-55c5-4c95-9e18-44f43b658dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ef85feac4d4101aafc6de33c5e5f25, user_id=d1cf2319fc444dc3ba53ed58b3cf8a63, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.773765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf30c4d-55c5-4c95-9e18-44f43b658dc6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.777914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af01f2-a23b-4427-94a0-9d8651d6bd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.778528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af01f2-a23b-4427-94a0-9d8651d6bd64 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.778801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af01f2-a23b-4427-94a0-9d8651d6bd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.779074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af01f2-a23b-4427-94a0-9d8651d6bd64 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.779735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af01f2-a23b-4427-94a0-9d8651d6bd64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.781685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af01f2-a23b-4427-94a0-9d8651d6bd64 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:00.872555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 780/1571] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:00 2022] PUT /identity/v3/projects/15ef85feac4d4101aafc6de33c5e5f25/users/d1cf2319fc444dc3ba53ed58b3cf8a63/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:00.873532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf30c4d-55c5-4c95-9e18-44f43b658dc6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.896150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 792/1572] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:00.897138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af01f2-a23b-4427-94a0-9d8651d6bd64 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:00.938344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf30c4d-55c5-4c95-9e18-44f43b658dc6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.939869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:00.962221 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af01f2-a23b-4427-94a0-9d8651d6bd64 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:00.967519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:00.969641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aed259-0794-4a6e-97dd-0ad369a0c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:00.971550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed259-0794-4a6e-97dd-0ad369a0c018 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:00.971860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed259-0794-4a6e-97dd-0ad369a0c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:00.972161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aed259-0794-4a6e-97dd-0ad369a0c018 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:00.972791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aed259-0794-4a6e-97dd-0ad369a0c018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:00.974837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aed259-0794-4a6e-97dd-0ad369a0c018 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.006637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a74c-c23d-4d72-a77b-7a4f8fd167e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.007282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a74c-c23d-4d72-a77b-7a4f8fd167e7 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.007566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a74c-c23d-4d72-a77b-7a4f8fd167e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.007838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682a74c-c23d-4d72-a77b-7a4f8fd167e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.008466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682a74c-c23d-4d72-a77b-7a4f8fd167e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.010402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682a74c-c23d-4d72-a77b-7a4f8fd167e7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.073177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 793/1573] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.073177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aed259-0794-4a6e-97dd-0ad369a0c018 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.080144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aed259-0794-4a6e-97dd-0ad369a0c018 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.085233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36070dc-04ca-44fd-9b8d-bc47243d97a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.085814 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36070dc-04ca-44fd-9b8d-bc47243d97a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.086096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36070dc-04ca-44fd-9b8d-bc47243d97a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.086368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36070dc-04ca-44fd-9b8d-bc47243d97a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.086983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36070dc-04ca-44fd-9b8d-bc47243d97a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.088945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36070dc-04ca-44fd-9b8d-bc47243d97a8 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.119296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 781/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:00 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.120345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a74c-c23d-4d72-a77b-7a4f8fd167e7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.181820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682a74c-c23d-4d72-a77b-7a4f8fd167e7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.186403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf9b37-e0b0-449c-a040-237f88552c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.187004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf9b37-e0b0-449c-a040-237f88552c90 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.187326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf9b37-e0b0-449c-a040-237f88552c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.187598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf9b37-e0b0-449c-a040-237f88552c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.188221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf9b37-e0b0-449c-a040-237f88552c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.190132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf9b37-e0b0-449c-a040-237f88552c90 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.211373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 794/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.212258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36070dc-04ca-44fd-9b8d-bc47243d97a8 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.276127 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 782/1576] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/projects => generated 393 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.276537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36070dc-04ca-44fd-9b8d-bc47243d97a8 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.277083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf9b37-e0b0-449c-a040-237f88552c90 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.337807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0afd2-c151-468e-9d54-8911a4a0a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.338571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0afd2-c151-468e-9d54-8911a4a0a81d admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.338852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0afd2-c151-468e-9d54-8911a4a0a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.339125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0afd2-c151-468e-9d54-8911a4a0a81d admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.339786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0afd2-c151-468e-9d54-8911a4a0a81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.340453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf9b37-e0b0-449c-a040-237f88552c90 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.341727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0afd2-c151-468e-9d54-8911a4a0a81d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.345171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c25d-aa44-47a3-a1a6-207e1796ea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.345766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c25d-aa44-47a3-a1a6-207e1796ea92 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.346043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c25d-aa44-47a3-a1a6-207e1796ea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.346311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630c25d-aa44-47a3-a1a6-207e1796ea92 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.346939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630c25d-aa44-47a3-a1a6-207e1796ea92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.347980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WARNING py.warnings [None req-d630c25d-aa44-47a3-a1a6-207e1796ea92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:59:01.347980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: warnings.warn(msg) Aug 22 19:59:01.347980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: Aug 22 19:59:01.350126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630c25d-aa44-47a3-a1a6-207e1796ea92 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.432724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 795/1577] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.433977 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583cf76-5c7d-4370-9d2e-37eb507b4f6f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.434255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583cf76-5c7d-4370-9d2e-37eb507b4f6f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.434522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583cf76-5c7d-4370-9d2e-37eb507b4f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.462447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3583cf76-5c7d-4370-9d2e-37eb507b4f6f None None] MFA Rules not processed for user `d1cf2319fc444dc3ba53ed58b3cf8a63`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:01.464052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3583cf76-5c7d-4370-9d2e-37eb507b4f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:01.469371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 783/1578] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.469371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c25d-aa44-47a3-a1a6-207e1796ea92 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.477782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630c25d-aa44-47a3-a1a6-207e1796ea92 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.482785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40075feb-222d-41a0-b1a9-24ff8514b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.483362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40075feb-222d-41a0-b1a9-24ff8514b54b admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.483640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40075feb-222d-41a0-b1a9-24ff8514b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.483914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40075feb-222d-41a0-b1a9-24ff8514b54b admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.484786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40075feb-222d-41a0-b1a9-24ff8514b54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.486728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40075feb-222d-41a0-b1a9-24ff8514b54b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.501965 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:01.536340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 796/1579] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:01.537235 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583cf76-5c7d-4370-9d2e-37eb507b4f6f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.547618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583cf76-5c7d-4370-9d2e-37eb507b4f6f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.553310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c914ad-67f9-42c7-974e-e0cbe0791afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.553418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c914ad-67f9-42c7-974e-e0cbe0791afc admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.553692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c914ad-67f9-42c7-974e-e0cbe0791afc admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.553957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c914ad-67f9-42c7-974e-e0cbe0791afc admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.554620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c914ad-67f9-42c7-974e-e0cbe0791afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.556252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c914ad-67f9-42c7-974e-e0cbe0791afc admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.566618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 797/1580] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.568257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c914ad-67f9-42c7-974e-e0cbe0791afc admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.578163 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c914ad-67f9-42c7-974e-e0cbe0791afc admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.583339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac86178-6965-4ff7-ac1b-7f95ed15801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.583339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac86178-6965-4ff7-ac1b-7f95ed15801e admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.583628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac86178-6965-4ff7-ac1b-7f95ed15801e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.583895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac86178-6965-4ff7-ac1b-7f95ed15801e admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.584506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac86178-6965-4ff7-ac1b-7f95ed15801e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.586412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac86178-6965-4ff7-ac1b-7f95ed15801e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.612346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 784/1581] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.617895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40075feb-222d-41a0-b1a9-24ff8514b54b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.623575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40075feb-222d-41a0-b1a9-24ff8514b54b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.628153 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836466-ccbf-4222-940d-d7e3db8724f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.628733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836466-ccbf-4222-940d-d7e3db8724f2 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.629033 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836466-ccbf-4222-940d-d7e3db8724f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.629306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836466-ccbf-4222-940d-d7e3db8724f2 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.630583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc836466-ccbf-4222-940d-d7e3db8724f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.632630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc836466-ccbf-4222-940d-d7e3db8724f2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.641389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:01.715105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 798/1582] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.715962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac86178-6965-4ff7-ac1b-7f95ed15801e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.726026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac86178-6965-4ff7-ac1b-7f95ed15801e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.730768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0e9cb-58fa-48f7-9827-56197180e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.731382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0e9cb-58fa-48f7-9827-56197180e052 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.731658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0e9cb-58fa-48f7-9827-56197180e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.731922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0e9cb-58fa-48f7-9827-56197180e052 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.732539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0e9cb-58fa-48f7-9827-56197180e052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.734775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0e9cb-58fa-48f7-9827-56197180e052 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.745108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 785/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/users => generated 284 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.746844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836466-ccbf-4222-940d-d7e3db8724f2 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.758482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836466-ccbf-4222-940d-d7e3db8724f2 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.763065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402c7b1-27b4-4a5b-a06a-6e14d5991a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.763682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402c7b1-27b4-4a5b-a06a-6e14d5991a4e admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.763987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402c7b1-27b4-4a5b-a06a-6e14d5991a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.764235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402c7b1-27b4-4a5b-a06a-6e14d5991a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.764873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402c7b1-27b4-4a5b-a06a-6e14d5991a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.766467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402c7b1-27b4-4a5b-a06a-6e14d5991a4e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.777124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 786/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.778008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402c7b1-27b4-4a5b-a06a-6e14d5991a4e admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.787997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402c7b1-27b4-4a5b-a06a-6e14d5991a4e admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.792736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bb518-b8a6-49ff-8efb-c9685448f8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.793225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bb518-b8a6-49ff-8efb-c9685448f8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.793500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bb518-b8a6-49ff-8efb-c9685448f8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.793807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bb518-b8a6-49ff-8efb-c9685448f8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.794407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bb518-b8a6-49ff-8efb-c9685448f8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.796033 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bb518-b8a6-49ff-8efb-c9685448f8a3 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.807397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 787/1585] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.808803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a486bd8-513a-4904-8a7f-dc09cae37b48 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.809087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a486bd8-513a-4904-8a7f-dc09cae37b48 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.809362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a486bd8-513a-4904-8a7f-dc09cae37b48 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.810831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 788/1586] 10.222.0.18 () {54 vars in 962 bytes} [Mon Aug 22 19:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:01.811563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a486bd8-513a-4904-8a7f-dc09cae37b48 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.823861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a486bd8-513a-4904-8a7f-dc09cae37b48 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.828433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cf389-5a92-4b29-9e41-f5807868eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.828997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cf389-5a92-4b29-9e41-f5807868eade admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.829279 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cf389-5a92-4b29-9e41-f5807868eade admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.829426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 799/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:01.829533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cf389-5a92-4b29-9e41-f5807868eade admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.830177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cf389-5a92-4b29-9e41-f5807868eade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.831670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0e9cb-58fa-48f7-9827-56197180e052 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.833879 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cf389-5a92-4b29-9e41-f5807868eade admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.843340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0e9cb-58fa-48f7-9827-56197180e052 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.843699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 789/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.844579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cf389-5a92-4b29-9e41-f5807868eade admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.851953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f166-03cd-4940-a541-c5c707c7da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.852705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f166-03cd-4940-a541-c5c707c7da36 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.852827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f166-03cd-4940-a541-c5c707c7da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.853177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f166-03cd-4940-a541-c5c707c7da36 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.853956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00f166-03cd-4940-a541-c5c707c7da36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.855479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00f166-03cd-4940-a541-c5c707c7da36 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.855627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cf389-5a92-4b29-9e41-f5807868eade admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.860597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c53a4-8cb5-457f-830f-bbf89277e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.861704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c53a4-8cb5-457f-830f-bbf89277e256 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.861704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c53a4-8cb5-457f-830f-bbf89277e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.861919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c53a4-8cb5-457f-830f-bbf89277e256 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.862495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c53a4-8cb5-457f-830f-bbf89277e256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.864417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c53a4-8cb5-457f-830f-bbf89277e256 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.866005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 800/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.866920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f166-03cd-4940-a541-c5c707c7da36 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.874897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 790/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.875941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c53a4-8cb5-457f-830f-bbf89277e256 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.876875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f166-03cd-4940-a541-c5c707c7da36 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.883302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826475cf-75f9-4673-98df-cc36c2b5c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.884326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826475cf-75f9-4673-98df-cc36c2b5c9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.884326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826475cf-75f9-4673-98df-cc36c2b5c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.884585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826475cf-75f9-4673-98df-cc36c2b5c9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.885075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826475cf-75f9-4673-98df-cc36c2b5c9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.886679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826475cf-75f9-4673-98df-cc36c2b5c9a8 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.886849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c53a4-8cb5-457f-830f-bbf89277e256 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.891985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40ec24-a838-43c6-8145-367b9afd4cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.892578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40ec24-a838-43c6-8145-367b9afd4cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.892854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40ec24-a838-43c6-8145-367b9afd4cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.893122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40ec24-a838-43c6-8145-367b9afd4cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.893757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40ec24-a838-43c6-8145-367b9afd4cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.896166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40ec24-a838-43c6-8145-367b9afd4cf3 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.898276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 801/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.898276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826475cf-75f9-4673-98df-cc36c2b5c9a8 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.907239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 791/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.908477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11882-2d8d-49d8-a0e5-f41127112e17 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.908681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826475cf-75f9-4673-98df-cc36c2b5c9a8 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.908786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11882-2d8d-49d8-a0e5-f41127112e17 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.909035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f11882-2d8d-49d8-a0e5-f41127112e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.916104 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf012f-3fc7-4058-b4f0-5e05e839befa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.916709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf012f-3fc7-4058-b4f0-5e05e839befa admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.917009 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf012f-3fc7-4058-b4f0-5e05e839befa admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.917280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf012f-3fc7-4058-b4f0-5e05e839befa admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.917929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf012f-3fc7-4058-b4f0-5e05e839befa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.919573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf012f-3fc7-4058-b4f0-5e05e839befa admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.931721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 802/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.932408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf012f-3fc7-4058-b4f0-5e05e839befa admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.943515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf012f-3fc7-4058-b4f0-5e05e839befa admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.949288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee32bc-327a-481a-9654-2c0e6dee7f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.949933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee32bc-327a-481a-9654-2c0e6dee7f3e admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.950209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee32bc-327a-481a-9654-2c0e6dee7f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.950478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee32bc-327a-481a-9654-2c0e6dee7f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:01.951157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee32bc-327a-481a-9654-2c0e6dee7f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:01.952856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee32bc-327a-481a-9654-2c0e6dee7f3e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:01.954016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e2f11882-2d8d-49d8-a0e5-f41127112e17 None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:01.955822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e2f11882-2d8d-49d8-a0e5-f41127112e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:01.965469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 803/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:01.966434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee32bc-327a-481a-9654-2c0e6dee7f3e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:01.977227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee32bc-327a-481a-9654-2c0e6dee7f3e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:01.983712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed9268-983a-4854-863e-2ec5644c48a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:01.984646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed9268-983a-4854-863e-2ec5644c48a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:01.985053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed9268-983a-4854-863e-2ec5644c48a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:01.985610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed9268-983a-4854-863e-2ec5644c48a5 admin admin] PATH_INFO: `/v3/projects/dd221bca74f74d9c8fe210a5c028e995/users/e395d0436d2443f5a6e55e137d375549/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.001464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed9268-983a-4854-863e-2ec5644c48a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd221bca74f74d9c8fe210a5c028e995, user_id=e395d0436d2443f5a6e55e137d375549, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.002552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING py.warnings [None req-2aed9268-983a-4854-863e-2ec5644c48a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:59:02.002552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: warnings.warn(msg) Aug 22 19:59:02.002552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: Aug 22 19:59:02.004550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed9268-983a-4854-863e-2ec5644c48a5 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.041617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 792/1595] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Aug 22 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:02.042623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f11882-2d8d-49d8-a0e5-f41127112e17 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.052482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f11882-2d8d-49d8-a0e5-f41127112e17 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.057108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b57c7-ad7d-4e78-b5d3-0b95dc056f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.057693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b57c7-ad7d-4e78-b5d3-0b95dc056f5b admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.057974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b57c7-ad7d-4e78-b5d3-0b95dc056f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.058245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b57c7-ad7d-4e78-b5d3-0b95dc056f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.058883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b57c7-ad7d-4e78-b5d3-0b95dc056f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.060531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b57c7-ad7d-4e78-b5d3-0b95dc056f5b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.071589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 793/1596] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:02.072521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b57c7-ad7d-4e78-b5d3-0b95dc056f5b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.075699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 804/1597] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:01 2022] PUT /identity/v3/projects/dd221bca74f74d9c8fe210a5c028e995/users/e395d0436d2443f5a6e55e137d375549/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:02.078090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed9268-983a-4854-863e-2ec5644c48a5 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.083621 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b57c7-ad7d-4e78-b5d3-0b95dc056f5b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.143489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1eaf7e-0e82-48d2-9710-ee462ae8c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.143754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed9268-983a-4854-863e-2ec5644c48a5 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.144103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eaf7e-0e82-48d2-9710-ee462ae8c088 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.144386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eaf7e-0e82-48d2-9710-ee462ae8c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.144661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eaf7e-0e82-48d2-9710-ee462ae8c088 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.145928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eaf7e-0e82-48d2-9710-ee462ae8c088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.148052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eaf7e-0e82-48d2-9710-ee462ae8c088 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.149249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da298d5-7c9d-4d3b-a6e2-c55dc0ec439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.149744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da298d5-7c9d-4d3b-a6e2-c55dc0ec439a admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.150039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da298d5-7c9d-4d3b-a6e2-c55dc0ec439a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.150306 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da298d5-7c9d-4d3b-a6e2-c55dc0ec439a admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.150937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da298d5-7c9d-4d3b-a6e2-c55dc0ec439a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.152646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da298d5-7c9d-4d3b-a6e2-c55dc0ec439a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.153505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:02.159012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 794/1598] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:02.164047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1eaf7e-0e82-48d2-9710-ee462ae8c088 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.164184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 805/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:02.164184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da298d5-7c9d-4d3b-a6e2-c55dc0ec439a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.170726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1eaf7e-0e82-48d2-9710-ee462ae8c088 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.175814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60782ce1-b2df-4a00-86f2-f51129f09190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.175972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da298d5-7c9d-4d3b-a6e2-c55dc0ec439a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.176460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60782ce1-b2df-4a00-86f2-f51129f09190 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.176775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60782ce1-b2df-4a00-86f2-f51129f09190 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.177230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60782ce1-b2df-4a00-86f2-f51129f09190 admin admin] PATH_INFO: `/v3/projects/2ac858f6427a47f9b7d51cbfc2a98a50/users/90ca41c3615048fbae86a3680489fc8e/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.180663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8445f-dbc2-4db0-87f5-0ca64ef62636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.181303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8445f-dbc2-4db0-87f5-0ca64ef62636 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.181584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8445f-dbc2-4db0-87f5-0ca64ef62636 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.181851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8445f-dbc2-4db0-87f5-0ca64ef62636 admin admin] PATH_INFO: `/v3/projects/8156f63d61814899aa9991c6cdd3d35d/users/2944d274e2d146968c7bb01968ec9720/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.193127 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60782ce1-b2df-4a00-86f2-f51129f09190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac858f6427a47f9b7d51cbfc2a98a50, user_id=90ca41c3615048fbae86a3680489fc8e, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.194440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:02.196145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60782ce1-b2df-4a00-86f2-f51129f09190 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.198935 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8445f-dbc2-4db0-87f5-0ca64ef62636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8156f63d61814899aa9991c6cdd3d35d, user_id=2944d274e2d146968c7bb01968ec9720, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.201680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8445f-dbc2-4db0-87f5-0ca64ef62636 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.286679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 795/1600] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:02 2022] PUT /identity/v3/projects/2ac858f6427a47f9b7d51cbfc2a98a50/users/90ca41c3615048fbae86a3680489fc8e/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:02.287491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60782ce1-b2df-4a00-86f2-f51129f09190 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.315667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 806/1601] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:02 2022] PUT /identity/v3/projects/8156f63d61814899aa9991c6cdd3d35d/users/2944d274e2d146968c7bb01968ec9720/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:02.316678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8445f-dbc2-4db0-87f5-0ca64ef62636 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.357247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60782ce1-b2df-4a00-86f2-f51129f09190 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.401472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8445f-dbc2-4db0-87f5-0ca64ef62636 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.407456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c06d-0565-458d-86df-1e18ebc1623d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.408085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c06d-0565-458d-86df-1e18ebc1623d service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.408498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c06d-0565-458d-86df-1e18ebc1623d service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.408819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c06d-0565-458d-86df-1e18ebc1623d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.426598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bb70a-358a-4e4b-9266-c662478546ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.427284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb70a-358a-4e4b-9266-c662478546ba admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.427570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb70a-358a-4e4b-9266-c662478546ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.427832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bb70a-358a-4e4b-9266-c662478546ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.428773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bb70a-358a-4e4b-9266-c662478546ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.430415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bb70a-358a-4e4b-9266-c662478546ba admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.439876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 796/1602] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:02.440732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bb70a-358a-4e4b-9266-c662478546ba admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.450287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bb70a-358a-4e4b-9266-c662478546ba admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.455155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3723a-6579-45e7-ba74-e6b54f329b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.455822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3723a-6579-45e7-ba74-e6b54f329b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.456106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3723a-6579-45e7-ba74-e6b54f329b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.456375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3723a-6579-45e7-ba74-e6b54f329b14 admin admin] PATH_INFO: `/v3/projects/10c85f50b92b497a883fe416cc6c7de6/users/e6d3fd0d74c94f88aef2f0be0047ee9a/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.471711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3723a-6579-45e7-ba74-e6b54f329b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c85f50b92b497a883fe416cc6c7de6, user_id=e6d3fd0d74c94f88aef2f0be0047ee9a, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.474613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949c06d-0565-458d-86df-1e18ebc1623d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.475188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3723a-6579-45e7-ba74-e6b54f329b14 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.476294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949c06d-0565-458d-86df-1e18ebc1623d service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.485685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 807/1603] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:02.486941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70e72a-3ab8-4ffd-a153-ca76fb1cf4e0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.487177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70e72a-3ab8-4ffd-a153-ca76fb1cf4e0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.487475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70e72a-3ab8-4ffd-a153-ca76fb1cf4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.506257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7f70e72a-3ab8-4ffd-a153-ca76fb1cf4e0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:02.507592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7f70e72a-3ab8-4ffd-a153-ca76fb1cf4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:02.515167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 808/1604] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:02.515791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70e72a-3ab8-4ffd-a153-ca76fb1cf4e0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.526195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70e72a-3ab8-4ffd-a153-ca76fb1cf4e0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.530741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cf181-514b-4486-abfe-2b50446177e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.531408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cf181-514b-4486-abfe-2b50446177e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.531684 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cf181-514b-4486-abfe-2b50446177e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.531956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cf181-514b-4486-abfe-2b50446177e7 admin admin] PATH_INFO: `/v3/projects/771923c3e25b49b6992ff740890cb9d7/users/6c831f26a1c344369b050ccf2bc24554/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.546327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 797/1605] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:02 2022] PUT /identity/v3/projects/10c85f50b92b497a883fe416cc6c7de6/users/e6d3fd0d74c94f88aef2f0be0047ee9a/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:02.547132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3723a-6579-45e7-ba74-e6b54f329b14 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.548884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cf181-514b-4486-abfe-2b50446177e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771923c3e25b49b6992ff740890cb9d7, user_id=6c831f26a1c344369b050ccf2bc24554, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.551715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cf181-514b-4486-abfe-2b50446177e7 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.607213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:02.612498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3723a-6579-45e7-ba74-e6b54f329b14 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.618945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 809/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:02 2022] PUT /identity/v3/projects/771923c3e25b49b6992ff740890cb9d7/users/6c831f26a1c344369b050ccf2bc24554/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:02.623872 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b776-d60b-47d9-aee6-91ca87d39b35 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.624161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b776-d60b-47d9-aee6-91ca87d39b35 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.624434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b776-d60b-47d9-aee6-91ca87d39b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.655408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d7f1b776-d60b-47d9-aee6-91ca87d39b35 None None] MFA Rules not processed for user `90ca41c3615048fbae86a3680489fc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:02.656696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d7f1b776-d60b-47d9-aee6-91ca87d39b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:02.671678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8982d-b550-4536-bdce-03b1d8416331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.672364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8982d-b550-4536-bdce-03b1d8416331 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.672703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8982d-b550-4536-bdce-03b1d8416331 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.672964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8982d-b550-4536-bdce-03b1d8416331 admin admin] PATH_INFO: `/v3/projects/624047ed3c4741d4a7d31c4135f09317/users/98b43b028a72467fa9f0ed5315fa3ab1/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.695517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8982d-b550-4536-bdce-03b1d8416331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624047ed3c4741d4a7d31c4135f09317, user_id=98b43b028a72467fa9f0ed5315fa3ab1, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.700122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8982d-b550-4536-bdce-03b1d8416331 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.722032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:02.742540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 810/1607] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:02.743825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982a32-3366-41ec-ae3c-55862f11269a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.744115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982a32-3366-41ec-ae3c-55862f11269a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.744380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982a32-3366-41ec-ae3c-55862f11269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.779373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 798/1608] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:02 2022] PUT /identity/v3/projects/624047ed3c4741d4a7d31c4135f09317/users/98b43b028a72467fa9f0ed5315fa3ab1/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:02.780411 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8982d-b550-4536-bdce-03b1d8416331 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.792251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-2d982a32-3366-41ec-ae3c-55862f11269a None None] MFA Rules not processed for user `2944d274e2d146968c7bb01968ec9720`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:02.793618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2d982a32-3366-41ec-ae3c-55862f11269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:02.850932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8982d-b550-4536-bdce-03b1d8416331 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.856625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1b4b-b0fa-459d-bb30-a473c7ad113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.857398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1b4b-b0fa-459d-bb30-a473c7ad113b admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.857780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1b4b-b0fa-459d-bb30-a473c7ad113b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.858159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1b4b-b0fa-459d-bb30-a473c7ad113b admin admin] PATH_INFO: `/v3/projects/1e56e536bbe8486ca8ad9ff518b2ced9/users/49fc8627822f4765b08db422e7e580df/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.863337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 811/1609] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:02.865904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982a32-3366-41ec-ae3c-55862f11269a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:02.876003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d1b4b-b0fa-459d-bb30-a473c7ad113b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e56e536bbe8486ca8ad9ff518b2ced9, user_id=49fc8627822f4765b08db422e7e580df, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.878971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d1b4b-b0fa-459d-bb30-a473c7ad113b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.923428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982a32-3366-41ec-ae3c-55862f11269a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:02.932482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92604a2f-4a67-4c15-b9d6-4ca68f73845b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:02.933114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92604a2f-4a67-4c15-b9d6-4ca68f73845b service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.933389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92604a2f-4a67-4c15-b9d6-4ca68f73845b service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.933658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92604a2f-4a67-4c15-b9d6-4ca68f73845b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.952391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92604a2f-4a67-4c15-b9d6-4ca68f73845b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:02.952391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92604a2f-4a67-4c15-b9d6-4ca68f73845b service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:02.956533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 799/1610] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:02 2022] PUT /identity/v3/projects/1e56e536bbe8486ca8ad9ff518b2ced9/users/49fc8627822f4765b08db422e7e580df/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:02.959142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b4e2-28f7-416e-b7c6-ae5f3c287a87 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.959671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b4e2-28f7-416e-b7c6-ae5f3c287a87 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.959797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 812/1611] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:02.960229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711b4e2-28f7-416e-b7c6-ae5f3c287a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.961052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a82499-3a0c-4dc5-92de-884bb7b2917e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:02.963459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a82499-3a0c-4dc5-92de-884bb7b2917e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:02.963873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a82499-3a0c-4dc5-92de-884bb7b2917e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:02.982855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4711b4e2-28f7-416e-b7c6-ae5f3c287a87 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:02.984843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4711b4e2-28f7-416e-b7c6-ae5f3c287a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:02.991771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-92a82499-3a0c-4dc5-92de-884bb7b2917e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:02.994237 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-92a82499-3a0c-4dc5-92de-884bb7b2917e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:03.056011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 800/1612] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:03.057221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711b4e2-28f7-416e-b7c6-ae5f3c287a87 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.061333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 813/1613] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:03.061333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8cfc-7b6e-4109-8e4d-2fd4cf057d5f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.061333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8cfc-7b6e-4109-8e4d-2fd4cf057d5f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.061333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8cfc-7b6e-4109-8e4d-2fd4cf057d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.074987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:03.094041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-226a8cfc-7b6e-4109-8e4d-2fd4cf057d5f None None] MFA Rules not processed for user `98b43b028a72467fa9f0ed5315fa3ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:03.095362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-226a8cfc-7b6e-4109-8e4d-2fd4cf057d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:03.101826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:03.150970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711b4e2-28f7-416e-b7c6-ae5f3c287a87 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.157712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52689a6-092a-4bc1-a284-f02d12db8ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.158640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52689a6-092a-4bc1-a284-f02d12db8ce7 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.159067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52689a6-092a-4bc1-a284-f02d12db8ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.159523 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52689a6-092a-4bc1-a284-f02d12db8ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.172777 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 814/1614] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:03.173700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8cfc-7b6e-4109-8e4d-2fd4cf057d5f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.184846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8cfc-7b6e-4109-8e4d-2fd4cf057d5f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.189875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a19061-f9cb-46a5-86e9-69f242d0ccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.190495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a19061-f9cb-46a5-86e9-69f242d0ccee admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.190838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a19061-f9cb-46a5-86e9-69f242d0ccee admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.194767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a19061-f9cb-46a5-86e9-69f242d0ccee admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.194767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a19061-f9cb-46a5-86e9-69f242d0ccee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.194767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a19061-f9cb-46a5-86e9-69f242d0ccee admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:03.227204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52689a6-092a-4bc1-a284-f02d12db8ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.228843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52689a6-092a-4bc1-a284-f02d12db8ce7 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:03.237999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 801/1615] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:03.239208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205e0ed-19fe-4635-8e6e-39d9c688edac None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.239718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205e0ed-19fe-4635-8e6e-39d9c688edac None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.240169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205e0ed-19fe-4635-8e6e-39d9c688edac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.258919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e205e0ed-19fe-4635-8e6e-39d9c688edac None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:03.260201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e205e0ed-19fe-4635-8e6e-39d9c688edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:03.267911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 802/1616] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:03.269093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330452-bc02-4ba7-9391-b9026bf7667f None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.269376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330452-bc02-4ba7-9391-b9026bf7667f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.269650 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330452-bc02-4ba7-9391-b9026bf7667f None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.271807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 803/1617] 10.222.0.18 () {54 vars in 962 bytes} [Mon Aug 22 19:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:03.272482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330452-bc02-4ba7-9391-b9026bf7667f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.288478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 815/1618] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:03 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:03.288478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a19061-f9cb-46a5-86e9-69f242d0ccee admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.348377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330452-bc02-4ba7-9391-b9026bf7667f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.361200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a19061-f9cb-46a5-86e9-69f242d0ccee admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.368652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ea87-006f-4431-9769-021f70d90a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.368652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ea87-006f-4431-9769-021f70d90a82 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.369740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ea87-006f-4431-9769-021f70d90a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.370117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ea87-006f-4431-9769-021f70d90a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.427250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8f005-b2ae-406c-ba60-683da56234fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.428004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8f005-b2ae-406c-ba60-683da56234fd service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.428285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8f005-b2ae-406c-ba60-683da56234fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.428559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8f005-b2ae-406c-ba60-683da56234fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.438219 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:03.451794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ea87-006f-4431-9769-021f70d90a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.453305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ea87-006f-4431-9769-021f70d90a82 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:03.464095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 816/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:03.464908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ea87-006f-4431-9769-021f70d90a82 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.506603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8f005-b2ae-406c-ba60-683da56234fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.509074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8f005-b2ae-406c-ba60-683da56234fd service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:03.513993 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:03.519359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 804/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:03.521432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512745c-ce2c-4445-9af8-7cde1016414c None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.521847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512745c-ce2c-4445-9af8-7cde1016414c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.522346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512745c-ce2c-4445-9af8-7cde1016414c None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.524159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 805/1621] 10.222.0.18 () {54 vars in 912 bytes} [Mon Aug 22 19:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:03.525352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839bddd-e899-45f3-b387-aa4192479dd7 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.525548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839bddd-e899-45f3-b387-aa4192479dd7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.525831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839bddd-e899-45f3-b387-aa4192479dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.542834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ea87-006f-4431-9769-021f70d90a82 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.548042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb742dc-9fe2-4ba1-bb95-b57fd6fad1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.549007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb742dc-9fe2-4ba1-bb95-b57fd6fad1ed service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.549351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb742dc-9fe2-4ba1-bb95-b57fd6fad1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.549693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb742dc-9fe2-4ba1-bb95-b57fd6fad1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.552176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9839bddd-e899-45f3-b387-aa4192479dd7 None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:03.553440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9839bddd-e899-45f3-b387-aa4192479dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:03.619881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb742dc-9fe2-4ba1-bb95-b57fd6fad1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.625245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb742dc-9fe2-4ba1-bb95-b57fd6fad1ed service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:03.652022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 806/1622] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Aug 22 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:03.653296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839bddd-e899-45f3-b387-aa4192479dd7 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.653823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 817/1623] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:03.656571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb742dc-9fe2-4ba1-bb95-b57fd6fad1ed service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.666997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839bddd-e899-45f3-b387-aa4192479dd7 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.672783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1d8fa-9300-4be8-8272-a9c8de38d654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.673900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d8fa-9300-4be8-8272-a9c8de38d654 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.674193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d8fa-9300-4be8-8272-a9c8de38d654 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.674713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d8fa-9300-4be8-8272-a9c8de38d654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.686553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb742dc-9fe2-4ba1-bb95-b57fd6fad1ed service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.693570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1d8fa-9300-4be8-8272-a9c8de38d654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.696800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27046dc6-4194-4ccc-8318-0238382bde13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.697813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1d8fa-9300-4be8-8272-a9c8de38d654 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:03.697942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27046dc6-4194-4ccc-8318-0238382bde13 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.698206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27046dc6-4194-4ccc-8318-0238382bde13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.699422 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27046dc6-4194-4ccc-8318-0238382bde13 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.703606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27046dc6-4194-4ccc-8318-0238382bde13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.703606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27046dc6-4194-4ccc-8318-0238382bde13 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:03.717747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 807/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:03.720423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428310b4-b244-4b4e-ac87-615f4e0d11e9 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.720721 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428310b4-b244-4b4e-ac87-615f4e0d11e9 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.721007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428310b4-b244-4b4e-ac87-615f4e0d11e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.773258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-428310b4-b244-4b4e-ac87-615f4e0d11e9 None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:03.781550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-428310b4-b244-4b4e-ac87-615f4e0d11e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:03.793238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 808/1625] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:03.794343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4f98-87d3-47c7-be2d-0f96df8de3cd None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.794679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4f98-87d3-47c7-be2d-0f96df8de3cd None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.794962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4f98-87d3-47c7-be2d-0f96df8de3cd None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.796482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 809/1626] 10.222.0.18 () {54 vars in 912 bytes} [Mon Aug 22 19:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:03.811402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5a82c-4121-4bd7-8aff-eab9820855d2 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.811833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5a82c-4121-4bd7-8aff-eab9820855d2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.812249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5a82c-4121-4bd7-8aff-eab9820855d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.838835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 818/1627] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:03 2022] POST /identity/v3/users => generated 308 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:03.838835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27046dc6-4194-4ccc-8318-0238382bde13 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.842988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-19a5a82c-4121-4bd7-8aff-eab9820855d2 None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:03.842988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-19a5a82c-4121-4bd7-8aff-eab9820855d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:03.858007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 810/1628] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:03.868225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27046dc6-4194-4ccc-8318-0238382bde13 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.868569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5a82c-4121-4bd7-8aff-eab9820855d2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.875423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0c10-ae1a-4f4b-88fd-4d04f59186ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.875741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0c10-ae1a-4f4b-88fd-4d04f59186ef service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.876022 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0c10-ae1a-4f4b-88fd-4d04f59186ef service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.876433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e0c10-ae1a-4f4b-88fd-4d04f59186ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.887454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5a82c-4121-4bd7-8aff-eab9820855d2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.894301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540d3b-0d93-4d5f-a7ae-5392bf402c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.895534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540d3b-0d93-4d5f-a7ae-5392bf402c2b admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.898748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540d3b-0d93-4d5f-a7ae-5392bf402c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.898748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540d3b-0d93-4d5f-a7ae-5392bf402c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.899004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e0c10-ae1a-4f4b-88fd-4d04f59186ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.899112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540d3b-0d93-4d5f-a7ae-5392bf402c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.899204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e0c10-ae1a-4f4b-88fd-4d04f59186ef service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:03.901326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540d3b-0d93-4d5f-a7ae-5392bf402c2b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:03.916113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 811/1629] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:03.922604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 819/1630] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:03.924271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540d3b-0d93-4d5f-a7ae-5392bf402c2b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:03.937137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540d3b-0d93-4d5f-a7ae-5392bf402c2b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:03.947029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04172d4f-5c76-402f-831d-350520003b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:03.947858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04172d4f-5c76-402f-831d-350520003b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:03.949548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04172d4f-5c76-402f-831d-350520003b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:03.949931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04172d4f-5c76-402f-831d-350520003b08 admin admin] PATH_INFO: `/v3/projects/af3c8894a43444fa833e2b8ae5af1438/users/5838f3c7b0f54d718ffbb35871f0515c/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:03.979585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04172d4f-5c76-402f-831d-350520003b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3c8894a43444fa833e2b8ae5af1438, user_id=5838f3c7b0f54d718ffbb35871f0515c, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:03.982390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04172d4f-5c76-402f-831d-350520003b08 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:04.070474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 812/1631] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:03 2022] PUT /identity/v3/projects/af3c8894a43444fa833e2b8ae5af1438/users/5838f3c7b0f54d718ffbb35871f0515c/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:04.071266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0c10-ae1a-4f4b-88fd-4d04f59186ef service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:04.088082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e0c10-ae1a-4f4b-88fd-4d04f59186ef service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:04.166811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc512e53-e218-46af-9e46-147d0704b235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:04.167701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512e53-e218-46af-9e46-147d0704b235 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:04.167919 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512e53-e218-46af-9e46-147d0704b235 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:04.168136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc512e53-e218-46af-9e46-147d0704b235 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:04.168843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512e53-e218-46af-9e46-147d0704b235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:04.171202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc512e53-e218-46af-9e46-147d0704b235 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:04.182629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 820/1632] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:04.188351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04172d4f-5c76-402f-831d-350520003b08 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:04.203543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04172d4f-5c76-402f-831d-350520003b08 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:04.211778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b504-94c2-4c7c-a03f-89097cec4231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:04.212968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b504-94c2-4c7c-a03f-89097cec4231 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:04.214229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b504-94c2-4c7c-a03f-89097cec4231 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:04.214601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b504-94c2-4c7c-a03f-89097cec4231 admin admin] PATH_INFO: `/v3/projects/af3c8894a43444fa833e2b8ae5af1438/users/5838f3c7b0f54d718ffbb35871f0515c/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:04.216900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1b504-94c2-4c7c-a03f-89097cec4231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3c8894a43444fa833e2b8ae5af1438, user_id=5838f3c7b0f54d718ffbb35871f0515c, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:04.221060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1b504-94c2-4c7c-a03f-89097cec4231 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:04.239928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 813/1633] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:04 2022] PUT /identity/v3/projects/af3c8894a43444fa833e2b8ae5af1438/users/5838f3c7b0f54d718ffbb35871f0515c/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:04.253649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33d9bc-23c2-4471-a649-9a202540c7c4 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:04.253937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33d9bc-23c2-4471-a649-9a202540c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:04.256527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33d9bc-23c2-4471-a649-9a202540c7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:04.318005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6e33d9bc-23c2-4471-a649-9a202540c7c4 None None] MFA Rules not processed for user `5838f3c7b0f54d718ffbb35871f0515c`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:04.319217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6e33d9bc-23c2-4471-a649-9a202540c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:04.369664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:04.416639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 821/1634] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:04 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:04.913797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b504-94c2-4c7c-a03f-89097cec4231 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:04.969785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:05.047858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b504-94c2-4c7c-a03f-89097cec4231 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:05.053045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45590b80-d8bc-45d8-a7ad-b26217c33e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:05.053808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45590b80-d8bc-45d8-a7ad-b26217c33e60 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:05.054161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45590b80-d8bc-45d8-a7ad-b26217c33e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:05.054502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45590b80-d8bc-45d8-a7ad-b26217c33e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:05.139257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33d9bc-23c2-4471-a649-9a202540c7c4 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:05.151738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33d9bc-23c2-4471-a649-9a202540c7c4 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:05.165595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a07c08-f79b-45e2-b21f-e2b00e57bf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:05.166472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a07c08-f79b-45e2-b21f-e2b00e57bf11 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:05.166709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a07c08-f79b-45e2-b21f-e2b00e57bf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:05.167068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a07c08-f79b-45e2-b21f-e2b00e57bf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:05.194699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a07c08-f79b-45e2-b21f-e2b00e57bf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:05.197540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a07c08-f79b-45e2-b21f-e2b00e57bf11 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:05.205797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45590b80-d8bc-45d8-a7ad-b26217c33e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:05.210169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45590b80-d8bc-45d8-a7ad-b26217c33e60 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:05.236633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 822/1635] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:05 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:05.245452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 814/1636] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:05.783352 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a07c08-f79b-45e2-b21f-e2b00e57bf11 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:05.784037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45590b80-d8bc-45d8-a7ad-b26217c33e60 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:05.791590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a07c08-f79b-45e2-b21f-e2b00e57bf11 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:05.806852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:05.806852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:05.806852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:05.806852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] PATH_INFO: `/v3/users/d1cf2319fc444dc3ba53ed58b3cf8a63` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:05.813496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cf2319fc444dc3ba53ed58b3cf8a63)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:05.813496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: WARNING py.warnings [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:59:05.813496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: warnings.warn(msg) Aug 22 19:59:05.813496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: Aug 22 19:59:05.813496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:05.840181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45590b80-d8bc-45d8-a7ad-b26217c33e60 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:05.846913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:05.847993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:05.848540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:05.849938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] PATH_INFO: `/v3/users/2944d274e2d146968c7bb01968ec9720` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:05.852007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2944d274e2d146968c7bb01968ec9720)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:05.854602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:06.113889 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cf2319fc444dc3ba53ed58b3cf8a63'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.115260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cf2319fc444dc3ba53ed58b3cf8a63'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.184265 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2944d274e2d146968c7bb01968ec9720'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.186644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2944d274e2d146968c7bb01968ec9720'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.202597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2944d274e2d146968c7bb01968ec9720'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.211970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cf2319fc444dc3ba53ed58b3cf8a63'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.225656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cf2319fc444dc3ba53ed58b3cf8a63'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.250210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-15400151-0222-4bd6-8b70-7421b0884e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cf2319fc444dc3ba53ed58b3cf8a63'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.257567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 823/1637] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:05 2022] DELETE /identity/v3/users/d1cf2319fc444dc3ba53ed58b3cf8a63 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:06.262095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490185b-5cc7-4378-a922-68e896b8c137 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:06.262542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490185b-5cc7-4378-a922-68e896b8c137 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:06.263068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490185b-5cc7-4378-a922-68e896b8c137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:06.283524 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8490185b-5cc7-4378-a922-68e896b8c137 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:06.285060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8490185b-5cc7-4378-a922-68e896b8c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:06.297423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2944d274e2d146968c7bb01968ec9720'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.300336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:06.320153 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-99f933a4-ef98-4219-8490-fa1887a87ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2944d274e2d146968c7bb01968ec9720'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:06.330373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 815/1638] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:05 2022] DELETE /identity/v3/users/2944d274e2d146968c7bb01968ec9720 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:06.335265 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130d8f2-47c3-409d-b4f4-b2dc6d842581 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:06.335743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130d8f2-47c3-409d-b4f4-b2dc6d842581 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:06.336500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130d8f2-47c3-409d-b4f4-b2dc6d842581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:06.376006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8130d8f2-47c3-409d-b4f4-b2dc6d842581 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:06.379021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:06.380938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8130d8f2-47c3-409d-b4f4-b2dc6d842581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:06.429689 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 824/1639] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:06.460718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490185b-5cc7-4378-a922-68e896b8c137 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:06.462523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8490185b-5cc7-4378-a922-68e896b8c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:06.483494 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 816/1640] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:06.572792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490185b-5cc7-4378-a922-68e896b8c137 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:06.601086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130d8f2-47c3-409d-b4f4-b2dc6d842581 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:06.633763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2ea58-1917-42bb-ab5a-4869c4b77d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:06.635074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ea58-1917-42bb-ab5a-4869c4b77d43 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:06.635074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ea58-1917-42bb-ab5a-4869c4b77d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:06.635074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ea58-1917-42bb-ab5a-4869c4b77d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:06.650417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2ea58-1917-42bb-ab5a-4869c4b77d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:06.652676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2ea58-1917-42bb-ab5a-4869c4b77d43 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:06.665344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 825/1641] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:06.691331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130d8f2-47c3-409d-b4f4-b2dc6d842581 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:06.696990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242a9ec-0626-424f-92b2-5b30e13773e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:06.704056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242a9ec-0626-424f-92b2-5b30e13773e4 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:06.704056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242a9ec-0626-424f-92b2-5b30e13773e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:06.704056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242a9ec-0626-424f-92b2-5b30e13773e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:06.712117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242a9ec-0626-424f-92b2-5b30e13773e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:06.714302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242a9ec-0626-424f-92b2-5b30e13773e4 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:06.727171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 817/1642] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:07.801798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2ea58-1917-42bb-ab5a-4869c4b77d43 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:07.804494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0dc2ea58-1917-42bb-ab5a-4869c4b77d43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:07.830295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2ea58-1917-42bb-ab5a-4869c4b77d43 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:07.847183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:07.848323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:07.849288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:07.849731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] PATH_INFO: `/v3/projects/15ef85feac4d4101aafc6de33c5e5f25` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:07.856946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ef85feac4d4101aafc6de33c5e5f25)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:07.859460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:08.143271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ef85feac4d4101aafc6de33c5e5f25', 'request_id': 'req-29b23865-996f-4892-a26f-a575db38b953'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:08.153452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ef85feac4d4101aafc6de33c5e5f25', 'request_id': 'req-29b23865-996f-4892-a26f-a575db38b953'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:08.261216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ef85feac4d4101aafc6de33c5e5f25', 'request_id': 'req-29b23865-996f-4892-a26f-a575db38b953'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:08.308833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] The token cache is being invalidate because project 15ef85feac4d4101aafc6de33c5e5f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:08.309109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:08.310770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-29b23865-996f-4892-a26f-a575db38b953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:08.312621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 826/1643] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:07 2022] DELETE /identity/v3/projects/15ef85feac4d4101aafc6de33c5e5f25 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:08.320035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1648e5-b29e-497f-9c66-199b1048708a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:08.320908 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1648e5-b29e-497f-9c66-199b1048708a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:08.321340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1648e5-b29e-497f-9c66-199b1048708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:08.381300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9e1648e5-b29e-497f-9c66-199b1048708a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:08.385409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9e1648e5-b29e-497f-9c66-199b1048708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:08.565385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 818/1644] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:08.577473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20850847-3c52-42d6-865d-fe667175ffd8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:08.577761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20850847-3c52-42d6-865d-fe667175ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:08.578038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20850847-3c52-42d6-865d-fe667175ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:08.620566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-20850847-3c52-42d6-865d-fe667175ffd8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:08.621902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-20850847-3c52-42d6-865d-fe667175ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:08.662664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1648e5-b29e-497f-9c66-199b1048708a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:08.663186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 827/1645] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:08.681172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1648e5-b29e-497f-9c66-199b1048708a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:08.711057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:08.711935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:08.713073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:08.713613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:08.714632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:08.715301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:08.720325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:08.790796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20850847-3c52-42d6-865d-fe667175ffd8 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:08.808070 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 819/1646] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:59:08.810142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:08.819542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:08.827614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20850847-3c52-42d6-865d-fe667175ffd8 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:08.850760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eba13f-836c-4614-a443-60d4e448abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:08.852556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eba13f-836c-4614-a443-60d4e448abbb admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:08.853004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eba13f-836c-4614-a443-60d4e448abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:08.853461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eba13f-836c-4614-a443-60d4e448abbb admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:08.854578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eba13f-836c-4614-a443-60d4e448abbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:08.861196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eba13f-836c-4614-a443-60d4e448abbb admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:08.873828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f3650-1726-4652-a7e0-939b18cdcba3 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:08.898900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:08.903383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:08.904769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:08.905242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] PATH_INFO: `/v3/projects/8156f63d61814899aa9991c6cdd3d35d` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:08.909456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8156f63d61814899aa9991c6cdd3d35d)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:08.915726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: WARNING py.warnings [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 19:59:08.915726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: warnings.warn(msg) Aug 22 19:59:08.915726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: Aug 22 19:59:08.925106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:08.971649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:09.063515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:09.093989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 828/1647] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:08 2022] POST /identity/v3/projects => generated 381 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:09.104275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eba13f-836c-4614-a443-60d4e448abbb admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:09.375212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8156f63d61814899aa9991c6cdd3d35d', 'request_id': 'req-dc0b9d43-ecc3-481a-8e27-d543d318df33'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:09.433723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8156f63d61814899aa9991c6cdd3d35d', 'request_id': 'req-dc0b9d43-ecc3-481a-8e27-d543d318df33'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:09.454886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eba13f-836c-4614-a443-60d4e448abbb admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:09.523025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8156f63d61814899aa9991c6cdd3d35d', 'request_id': 'req-dc0b9d43-ecc3-481a-8e27-d543d318df33'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:09.617675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d112666-2365-4b09-a567-0da076dac4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:09.617675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112666-2365-4b09-a567-0da076dac4ce admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:09.618676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112666-2365-4b09-a567-0da076dac4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:09.619294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112666-2365-4b09-a567-0da076dac4ce admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:09.620991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d112666-2365-4b09-a567-0da076dac4ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:09.628737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d112666-2365-4b09-a567-0da076dac4ce admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:09.645175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] The token cache is being invalidate because project 8156f63d61814899aa9991c6cdd3d35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:09.645691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:09.647656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:09.654201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 820/1648] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:08 2022] DELETE /identity/v3/projects/8156f63d61814899aa9991c6cdd3d35d => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:09.655343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:09.658592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:09.700643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b9d43-ecc3-481a-8e27-d543d318df33 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:09.706848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:09.707652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:09.707971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:09.709982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] PATH_INFO: `/v3/users/5838f3c7b0f54d718ffbb35871f0515c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:09.712095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5838f3c7b0f54d718ffbb35871f0515c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:09.714941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:09.738629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 829/1649] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:09 2022] POST /identity/v3/users => generated 291 bytes in 636 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:09.746628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d112666-2365-4b09-a567-0da076dac4ce admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:09.748161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1d112666-2365-4b09-a567-0da076dac4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:09.774919 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d112666-2365-4b09-a567-0da076dac4ce admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:09.792375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca8ec-1e9d-404a-b86c-41982ce7568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:09.792375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca8ec-1e9d-404a-b86c-41982ce7568b admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:09.792375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca8ec-1e9d-404a-b86c-41982ce7568b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:09.792375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca8ec-1e9d-404a-b86c-41982ce7568b admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:09.792783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aca8ec-1e9d-404a-b86c-41982ce7568b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:09.813216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aca8ec-1e9d-404a-b86c-41982ce7568b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:09.850604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 830/1650] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:09.857027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca8ec-1e9d-404a-b86c-41982ce7568b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:09.896063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca8ec-1e9d-404a-b86c-41982ce7568b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:09.909825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f1d8d-fa80-4ec3-8ae0-30ad3ad29a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:09.910586 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f1d8d-fa80-4ec3-8ae0-30ad3ad29a3a admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:09.913961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f1d8d-fa80-4ec3-8ae0-30ad3ad29a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:09.914331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f1d8d-fa80-4ec3-8ae0-30ad3ad29a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:09.914972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f1d8d-fa80-4ec3-8ae0-30ad3ad29a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:09.916798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f1d8d-fa80-4ec3-8ae0-30ad3ad29a3a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:09.955557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 831/1651] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:09.962022 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f1d8d-fa80-4ec3-8ae0-30ad3ad29a3a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:09.975788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f1d8d-fa80-4ec3-8ae0-30ad3ad29a3a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:09.981688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfff729-2e8e-473c-aaff-39b74604b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:09.982426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfff729-2e8e-473c-aaff-39b74604b7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:09.982840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfff729-2e8e-473c-aaff-39b74604b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:09.983110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfff729-2e8e-473c-aaff-39b74604b7ce admin admin] PATH_INFO: `/v3/projects/1f05ef93b4984d009c26553254d98e92/users/d33064c090fc42eaafdbcd412be7eb1f/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:10.055726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfff729-2e8e-473c-aaff-39b74604b7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f05ef93b4984d009c26553254d98e92, user_id=d33064c090fc42eaafdbcd412be7eb1f, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:10.061288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5838f3c7b0f54d718ffbb35871f0515c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:10.066751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5838f3c7b0f54d718ffbb35871f0515c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:10.070626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfff729-2e8e-473c-aaff-39b74604b7ce admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:10.091575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5838f3c7b0f54d718ffbb35871f0515c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:10.180895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 832/1652] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:09 2022] PUT /identity/v3/projects/1f05ef93b4984d009c26553254d98e92/users/d33064c090fc42eaafdbcd412be7eb1f/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:10.206242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fad21-afa5-4585-9620-6350331a5ff3 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:10.206242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fad21-afa5-4585-9620-6350331a5ff3 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:10.206242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fad21-afa5-4585-9620-6350331a5ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:10.226883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5838f3c7b0f54d718ffbb35871f0515c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:10.274711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c38fad21-afa5-4585-9620-6350331a5ff3 None None] MFA Rules not processed for user `d33064c090fc42eaafdbcd412be7eb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:10.277813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c38fad21-afa5-4585-9620-6350331a5ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:10.279927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5838f3c7b0f54d718ffbb35871f0515c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:10.312484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 821/1653] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:09 2022] DELETE /identity/v3/users/5838f3c7b0f54d718ffbb35871f0515c => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:10.502924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 833/1654] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 22 19:59:10.508839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:10.511139 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:10.721484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d3285-3abf-4fe4-b426-6db4dc3bfa82 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:10.727761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806ad0-8a83-4ce8-8d3e-134dc8cc5f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:10.728615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806ad0-8a83-4ce8-8d3e-134dc8cc5f31 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:10.728777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806ad0-8a83-4ce8-8d3e-134dc8cc5f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:10.729090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806ad0-8a83-4ce8-8d3e-134dc8cc5f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:10.729897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b806ad0-8a83-4ce8-8d3e-134dc8cc5f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:10.731834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b806ad0-8a83-4ce8-8d3e-134dc8cc5f31 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:10.764583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:10.766048 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:10.918096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 822/1655] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:10 2022] POST /identity/v3/projects => generated 375 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:10.922587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fad21-afa5-4585-9620-6350331a5ff3 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:11.061468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fad21-afa5-4585-9620-6350331a5ff3 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:11.155707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f381489-49bf-4d5c-87fa-d87acfbfb81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:11.156572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f381489-49bf-4d5c-87fa-d87acfbfb81c admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:11.157057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f381489-49bf-4d5c-87fa-d87acfbfb81c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:11.162116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f381489-49bf-4d5c-87fa-d87acfbfb81c admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:11.163672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f381489-49bf-4d5c-87fa-d87acfbfb81c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:11.171504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f381489-49bf-4d5c-87fa-d87acfbfb81c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:11.357751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 834/1656] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:10 2022] POST /identity/v3/users => generated 294 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:11.361986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806ad0-8a83-4ce8-8d3e-134dc8cc5f31 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:11.389245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806ad0-8a83-4ce8-8d3e-134dc8cc5f31 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:11.414042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d098d-6bf8-4a8a-b3ea-b2d913c7f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:11.414831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d098d-6bf8-4a8a-b3ea-b2d913c7f66c admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:11.416190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d098d-6bf8-4a8a-b3ea-b2d913c7f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:11.416568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d098d-6bf8-4a8a-b3ea-b2d913c7f66c admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:11.422030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d098d-6bf8-4a8a-b3ea-b2d913c7f66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:11.424128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d098d-6bf8-4a8a-b3ea-b2d913c7f66c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:11.455729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 823/1657] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:11.457293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f381489-49bf-4d5c-87fa-d87acfbfb81c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:11.477998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f381489-49bf-4d5c-87fa-d87acfbfb81c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:11.495388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c676e-d637-4aae-bde8-8298a237c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:11.496452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c676e-d637-4aae-bde8-8298a237c990 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:11.497003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c676e-d637-4aae-bde8-8298a237c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:11.500952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c676e-d637-4aae-bde8-8298a237c990 admin admin] PATH_INFO: `/v3/projects/9c426211241843649505b1629e24dae6/users/3425b4c27b5b4179a46f57bec8ab7d6d/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:11.541102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c676e-d637-4aae-bde8-8298a237c990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c426211241843649505b1629e24dae6, user_id=3425b4c27b5b4179a46f57bec8ab7d6d, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:11.546085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c676e-d637-4aae-bde8-8298a237c990 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:11.716390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 835/1658] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:11 2022] PUT /identity/v3/projects/9c426211241843649505b1629e24dae6/users/3425b4c27b5b4179a46f57bec8ab7d6d/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:11.717570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d098d-6bf8-4a8a-b3ea-b2d913c7f66c admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:11.737563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d098d-6bf8-4a8a-b3ea-b2d913c7f66c admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:11.876333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9886b-6e40-4fd0-92b2-939e0c076466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:11.877338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9886b-6e40-4fd0-92b2-939e0c076466 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:11.879681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9886b-6e40-4fd0-92b2-939e0c076466 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:11.880742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9886b-6e40-4fd0-92b2-939e0c076466 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:11.881733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9886b-6e40-4fd0-92b2-939e0c076466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:11.885917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9886b-6e40-4fd0-92b2-939e0c076466 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:11.917899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 824/1659] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:11.921188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c676e-d637-4aae-bde8-8298a237c990 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:11.933768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c676e-d637-4aae-bde8-8298a237c990 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:11.940019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc0fdb-be4d-493a-b0bf-51aafe367310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:11.941028 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc0fdb-be4d-493a-b0bf-51aafe367310 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:11.941454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc0fdb-be4d-493a-b0bf-51aafe367310 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:11.941964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc0fdb-be4d-493a-b0bf-51aafe367310 admin admin] PATH_INFO: `/v3/projects/9c426211241843649505b1629e24dae6/users/3425b4c27b5b4179a46f57bec8ab7d6d/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:11.945452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc0fdb-be4d-493a-b0bf-51aafe367310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c426211241843649505b1629e24dae6, user_id=3425b4c27b5b4179a46f57bec8ab7d6d, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:11.948415 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc0fdb-be4d-493a-b0bf-51aafe367310 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:11.973630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 836/1660] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:11 2022] PUT /identity/v3/projects/9c426211241843649505b1629e24dae6/users/3425b4c27b5b4179a46f57bec8ab7d6d/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:11.976248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639053c2-034a-47b3-a379-abdca803703d None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:11.977018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639053c2-034a-47b3-a379-abdca803703d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:11.977408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639053c2-034a-47b3-a379-abdca803703d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:12.037180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-639053c2-034a-47b3-a379-abdca803703d None None] MFA Rules not processed for user `3425b4c27b5b4179a46f57bec8ab7d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:12.039656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-639053c2-034a-47b3-a379-abdca803703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:12.206405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 825/1661] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:12.220288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc0fdb-be4d-493a-b0bf-51aafe367310 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:12.223308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f5bc0fdb-be4d-493a-b0bf-51aafe367310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:12.297600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:12.321678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc0fdb-be4d-493a-b0bf-51aafe367310 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:12.329264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433ace-6d2c-4a59-a5d9-de55f101a0e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:12.329912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433ace-6d2c-4a59-a5d9-de55f101a0e1 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:12.330580 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433ace-6d2c-4a59-a5d9-de55f101a0e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:12.330580 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1433ace-6d2c-4a59-a5d9-de55f101a0e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:12.366392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1433ace-6d2c-4a59-a5d9-de55f101a0e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:12.375329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1433ace-6d2c-4a59-a5d9-de55f101a0e1 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:12.398236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 837/1662] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:12.652379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639053c2-034a-47b3-a379-abdca803703d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:12.654728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-639053c2-034a-47b3-a379-abdca803703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:12.748119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433ace-6d2c-4a59-a5d9-de55f101a0e1 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:12.759031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1433ace-6d2c-4a59-a5d9-de55f101a0e1 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:12.765118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ba88b-9e09-433c-89ef-d9ad4f00f565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:12.774517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ba88b-9e09-433c-89ef-d9ad4f00f565 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:12.776617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ba88b-9e09-433c-89ef-d9ad4f00f565 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:12.777170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ba88b-9e09-433c-89ef-d9ad4f00f565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:12.821204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639053c2-034a-47b3-a379-abdca803703d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:12.832999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:12.834572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:12.834849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:12.835123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] PATH_INFO: `/v3/projects/af3c8894a43444fa833e2b8ae5af1438` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:12.837081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3c8894a43444fa833e2b8ae5af1438)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:12.846814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:12.860499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:12.975597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ba88b-9e09-433c-89ef-d9ad4f00f565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:12.977070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ba88b-9e09-433c-89ef-d9ad4f00f565 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:13.036619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 838/1663] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:13.052902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3c8894a43444fa833e2b8ae5af1438', 'request_id': 'req-5c31eb1c-9a06-4695-9c59-932a14958097'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.087447 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3c8894a43444fa833e2b8ae5af1438', 'request_id': 'req-5c31eb1c-9a06-4695-9c59-932a14958097'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.100328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3c8894a43444fa833e2b8ae5af1438', 'request_id': 'req-5c31eb1c-9a06-4695-9c59-932a14958097'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.147357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ba88b-9e09-433c-89ef-d9ad4f00f565 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:13.149079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6c5ba88b-9e09-433c-89ef-d9ad4f00f565 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:13.164662 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ba88b-9e09-433c-89ef-d9ad4f00f565 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:13.210841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] The token cache is being invalidate because project af3c8894a43444fa833e2b8ae5af1438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:13.211738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.212833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5c31eb1c-9a06-4695-9c59-932a14958097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.214958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 826/1664] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:12 2022] DELETE /identity/v3/projects/af3c8894a43444fa833e2b8ae5af1438 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:13.220267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1387f-6f3d-4a6d-a548-dd2f39ed59ce None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:13.221037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1387f-6f3d-4a6d-a548-dd2f39ed59ce None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:13.221446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1387f-6f3d-4a6d-a548-dd2f39ed59ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:13.278514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-5fe1387f-6f3d-4a6d-a548-dd2f39ed59ce None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:13.281138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5fe1387f-6f3d-4a6d-a548-dd2f39ed59ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:13.309711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:13.310957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:13.313181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:13.313625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] PATH_INFO: `/v3/users/90ca41c3615048fbae86a3680489fc8e` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:13.316714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ca41c3615048fbae86a3680489fc8e)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:13.322581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:13.417520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 827/1665] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:13.425957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50159e0-da26-40ad-9fc7-66ac05b82349 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:13.426494 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50159e0-da26-40ad-9fc7-66ac05b82349 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:13.427548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50159e0-da26-40ad-9fc7-66ac05b82349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:13.480913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-a50159e0-da26-40ad-9fc7-66ac05b82349 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:13.483337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a50159e0-da26-40ad-9fc7-66ac05b82349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:13.508588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 828/1666] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:13.510395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50159e0-da26-40ad-9fc7-66ac05b82349 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:13.537406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50159e0-da26-40ad-9fc7-66ac05b82349 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:13.555906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105b3ee-005a-4a49-bbc3-1d12fbea2869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:13.556947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105b3ee-005a-4a49-bbc3-1d12fbea2869 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:13.557389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105b3ee-005a-4a49-bbc3-1d12fbea2869 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:13.557796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105b3ee-005a-4a49-bbc3-1d12fbea2869 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:13.559408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105b3ee-005a-4a49-bbc3-1d12fbea2869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:13.560271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105b3ee-005a-4a49-bbc3-1d12fbea2869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:13.563832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105b3ee-005a-4a49-bbc3-1d12fbea2869 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:13.597500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 829/1667] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:59:13.603009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105b3ee-005a-4a49-bbc3-1d12fbea2869 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:13.624291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105b3ee-005a-4a49-bbc3-1d12fbea2869 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:13.641383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30002c76-1457-4298-a08d-0d9b2221ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:13.646313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30002c76-1457-4298-a08d-0d9b2221ade8 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:13.646313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30002c76-1457-4298-a08d-0d9b2221ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:13.646313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30002c76-1457-4298-a08d-0d9b2221ade8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:13.647261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30002c76-1457-4298-a08d-0d9b2221ade8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:13.652325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30002c76-1457-4298-a08d-0d9b2221ade8 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:13.663564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ca41c3615048fbae86a3680489fc8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.674482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ca41c3615048fbae86a3680489fc8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.751471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ca41c3615048fbae86a3680489fc8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.763884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 830/1668] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:13 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:13.770013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ca41c3615048fbae86a3680489fc8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.773050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30002c76-1457-4298-a08d-0d9b2221ade8 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:13.778169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-30002c76-1457-4298-a08d-0d9b2221ade8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:13.812102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-84875053-7db3-4648-b50b-fc5a3e4ef046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ca41c3615048fbae86a3680489fc8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:13.819432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:13.829997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 839/1669] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:13 2022] DELETE /identity/v3/users/90ca41c3615048fbae86a3680489fc8e => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:13.835754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78924009-168b-4054-b319-98683a93c51a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:13.836100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78924009-168b-4054-b319-98683a93c51a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:13.836536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78924009-168b-4054-b319-98683a93c51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:13.890905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-78924009-168b-4054-b319-98683a93c51a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:13.897304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-78924009-168b-4054-b319-98683a93c51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:13.981771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30002c76-1457-4298-a08d-0d9b2221ade8 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:14.027655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 840/1670] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:14.111837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:14.124635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30795e4c-83a3-44b7-83ae-c7465fcc3c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:14.125276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30795e4c-83a3-44b7-83ae-c7465fcc3c4e admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:14.125767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30795e4c-83a3-44b7-83ae-c7465fcc3c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:14.126046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30795e4c-83a3-44b7-83ae-c7465fcc3c4e admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:14.126738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30795e4c-83a3-44b7-83ae-c7465fcc3c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:14.133405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30795e4c-83a3-44b7-83ae-c7465fcc3c4e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:14.184943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78924009-168b-4054-b319-98683a93c51a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:14.186591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-78924009-168b-4054-b319-98683a93c51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:14.254247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 831/1671] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:13 2022] POST /identity/v3/users => generated 291 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:14.258829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30795e4c-83a3-44b7-83ae-c7465fcc3c4e admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:14.281824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30795e4c-83a3-44b7-83ae-c7465fcc3c4e admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:14.284927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78924009-168b-4054-b319-98683a93c51a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:14.299665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9ff03-5102-42e5-a056-a510c5ae3b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:14.300649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9ff03-5102-42e5-a056-a510c5ae3b1b service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:14.301233 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971aae6-e179-484f-a737-35b46877d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:14.301679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9ff03-5102-42e5-a056-a510c5ae3b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:14.302476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971aae6-e179-484f-a737-35b46877d7ce admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:14.302933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971aae6-e179-484f-a737-35b46877d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:14.303195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9ff03-5102-42e5-a056-a510c5ae3b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:14.303366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971aae6-e179-484f-a737-35b46877d7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:14.303894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971aae6-e179-484f-a737-35b46877d7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:14.306092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971aae6-e179-484f-a737-35b46877d7ce admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:14.328711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 832/1672] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:59:14.329804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971aae6-e179-484f-a737-35b46877d7ce admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:14.330340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9ff03-5102-42e5-a056-a510c5ae3b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:14.335480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9ff03-5102-42e5-a056-a510c5ae3b1b service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:14.350425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971aae6-e179-484f-a737-35b46877d7ce admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:14.363369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 841/1673] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:14.365390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f225d5-8590-42f8-a1bf-dcb39c969c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:14.366102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f225d5-8590-42f8-a1bf-dcb39c969c7c admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:14.366397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f225d5-8590-42f8-a1bf-dcb39c969c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:14.366676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f225d5-8590-42f8-a1bf-dcb39c969c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:14.367361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f225d5-8590-42f8-a1bf-dcb39c969c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:14.369008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f225d5-8590-42f8-a1bf-dcb39c969c7c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:14.400565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 833/1674] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:59:14.403791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9ff03-5102-42e5-a056-a510c5ae3b1b service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:14.421641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9ff03-5102-42e5-a056-a510c5ae3b1b service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:14.442134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94e16-65d2-4e5b-a14f-c0e6a7c15894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:14.442626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94e16-65d2-4e5b-a14f-c0e6a7c15894 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:14.443160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94e16-65d2-4e5b-a14f-c0e6a7c15894 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:14.443563 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94e16-65d2-4e5b-a14f-c0e6a7c15894 admin admin] PATH_INFO: `/v3/projects/94c4be7105324236b1d67d242e700937/users/a79a5450e2eb4c228169e4ed62319251/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:14.476993 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af94e16-65d2-4e5b-a14f-c0e6a7c15894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c4be7105324236b1d67d242e700937, user_id=a79a5450e2eb4c228169e4ed62319251, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:14.488582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af94e16-65d2-4e5b-a14f-c0e6a7c15894 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:14.567484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 842/1675] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:14 2022] PUT /identity/v3/projects/94c4be7105324236b1d67d242e700937/users/a79a5450e2eb4c228169e4ed62319251/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:14.582603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa193319-9c55-4c65-a29a-9c6e30e1b5cf None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:14.583711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa193319-9c55-4c65-a29a-9c6e30e1b5cf None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:14.584132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa193319-9c55-4c65-a29a-9c6e30e1b5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:14.660038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fa193319-9c55-4c65-a29a-9c6e30e1b5cf None None] MFA Rules not processed for user `a79a5450e2eb4c228169e4ed62319251`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:14.661635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fa193319-9c55-4c65-a29a-9c6e30e1b5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:14.830311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 834/1676] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:14.835605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94e16-65d2-4e5b-a14f-c0e6a7c15894 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:14.971105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94e16-65d2-4e5b-a14f-c0e6a7c15894 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:14.978562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f577d6-07cd-426c-8b28-602eb841c1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:14.979631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f577d6-07cd-426c-8b28-602eb841c1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:14.980167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f577d6-07cd-426c-8b28-602eb841c1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:14.980550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f577d6-07cd-426c-8b28-602eb841c1f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:14.981425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f577d6-07cd-426c-8b28-602eb841c1f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:14.984668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f577d6-07cd-426c-8b28-602eb841c1f4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:15.115578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa193319-9c55-4c65-a29a-9c6e30e1b5cf None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:15.128693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 843/1677] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:14 2022] POST /identity/v3/projects => generated 381 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:15.134348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa193319-9c55-4c65-a29a-9c6e30e1b5cf None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:15.342708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684ca87-3d82-4936-8213-4eb1fcc2d76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:15.343369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684ca87-3d82-4936-8213-4eb1fcc2d76b admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:15.343644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684ca87-3d82-4936-8213-4eb1fcc2d76b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:15.343909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684ca87-3d82-4936-8213-4eb1fcc2d76b admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:15.345548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684ca87-3d82-4936-8213-4eb1fcc2d76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:15.347537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684ca87-3d82-4936-8213-4eb1fcc2d76b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:15.478832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 835/1678] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:15 2022] POST /identity/v3/users => generated 297 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:15.483326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f577d6-07cd-426c-8b28-602eb841c1f4 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:15.501416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f577d6-07cd-426c-8b28-602eb841c1f4 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:15.523272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e10e-5470-4f2d-a9b7-f3db8bdf9231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:15.523272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e10e-5470-4f2d-a9b7-f3db8bdf9231 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:15.523272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e10e-5470-4f2d-a9b7-f3db8bdf9231 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:15.523272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73e10e-5470-4f2d-a9b7-f3db8bdf9231 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:15.523657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73e10e-5470-4f2d-a9b7-f3db8bdf9231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:15.525647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73e10e-5470-4f2d-a9b7-f3db8bdf9231 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:15.562754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 844/1679] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:59:15.567868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684ca87-3d82-4936-8213-4eb1fcc2d76b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:15.582122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684ca87-3d82-4936-8213-4eb1fcc2d76b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:15.605851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a293fc-299d-48e2-8f65-667561921157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:15.608303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a293fc-299d-48e2-8f65-667561921157 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:15.608989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a293fc-299d-48e2-8f65-667561921157 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:15.609610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a293fc-299d-48e2-8f65-667561921157 admin admin] PATH_INFO: `/v3/projects/38c3a9153a6a4c21bc6e8824556ca75a/users/3ebdb863212c4e89bb8b059f709c4005/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:15.660684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a293fc-299d-48e2-8f65-667561921157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c3a9153a6a4c21bc6e8824556ca75a, user_id=3ebdb863212c4e89bb8b059f709c4005, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:15.666449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a293fc-299d-48e2-8f65-667561921157 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:15.774954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:15.847332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 836/1680] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:15 2022] PUT /identity/v3/projects/38c3a9153a6a4c21bc6e8824556ca75a/users/3ebdb863212c4e89bb8b059f709c4005/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:15.849489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e10e-5470-4f2d-a9b7-f3db8bdf9231 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:15.863302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73e10e-5470-4f2d-a9b7-f3db8bdf9231 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:16.024150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fe5b9-5ca6-4ba0-b0ce-426408bae698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:16.026119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe5b9-5ca6-4ba0-b0ce-426408bae698 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:16.026777 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe5b9-5ca6-4ba0-b0ce-426408bae698 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:16.031480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe5b9-5ca6-4ba0-b0ce-426408bae698 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:16.031480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fe5b9-5ca6-4ba0-b0ce-426408bae698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:16.031480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fe5b9-5ca6-4ba0-b0ce-426408bae698 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:16.047369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 845/1681] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:16.049083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a293fc-299d-48e2-8f65-667561921157 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:16.066122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a293fc-299d-48e2-8f65-667561921157 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:16.075909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c467d3-7e50-4f1f-bdbf-d1f961d18d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:16.077517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c467d3-7e50-4f1f-bdbf-d1f961d18d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:16.078003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c467d3-7e50-4f1f-bdbf-d1f961d18d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:16.078475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c467d3-7e50-4f1f-bdbf-d1f961d18d94 admin admin] PATH_INFO: `/v3/projects/38c3a9153a6a4c21bc6e8824556ca75a/users/3ebdb863212c4e89bb8b059f709c4005/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:16.083875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c467d3-7e50-4f1f-bdbf-d1f961d18d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c3a9153a6a4c21bc6e8824556ca75a, user_id=3ebdb863212c4e89bb8b059f709c4005, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:16.087495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c467d3-7e50-4f1f-bdbf-d1f961d18d94 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:16.111246 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 837/1682] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:16 2022] PUT /identity/v3/projects/38c3a9153a6a4c21bc6e8824556ca75a/users/3ebdb863212c4e89bb8b059f709c4005/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:16.112337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fe5b9-5ca6-4ba0-b0ce-426408bae698 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:16.113647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504b00e-66f9-4b33-9b77-dbab18de13c3 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:16.114135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504b00e-66f9-4b33-9b77-dbab18de13c3 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:16.115053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504b00e-66f9-4b33-9b77-dbab18de13c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:16.118477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0c4fe5b9-5ca6-4ba0-b0ce-426408bae698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:16.158007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fe5b9-5ca6-4ba0-b0ce-426408bae698 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:16.170559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:16.175348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9504b00e-66f9-4b33-9b77-dbab18de13c3 None None] MFA Rules not processed for user `3ebdb863212c4e89bb8b059f709c4005`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:16.177677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9504b00e-66f9-4b33-9b77-dbab18de13c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:16.373537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:16.374293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:16.374574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:16.374846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] PATH_INFO: `/v3/projects/2ac858f6427a47f9b7d51cbfc2a98a50` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:16.377595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac858f6427a47f9b7d51cbfc2a98a50)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:16.382728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 838/1683] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:16.382881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:16.390180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504b00e-66f9-4b33-9b77-dbab18de13c3 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:16.398906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9504b00e-66f9-4b33-9b77-dbab18de13c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:16.553902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504b00e-66f9-4b33-9b77-dbab18de13c3 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:16.580005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e820b-a998-4289-8c65-0fc2e4ae7b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:16.580773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e820b-a998-4289-8c65-0fc2e4ae7b58 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:16.580970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e820b-a998-4289-8c65-0fc2e4ae7b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:16.581206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e820b-a998-4289-8c65-0fc2e4ae7b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:16.609695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e820b-a998-4289-8c65-0fc2e4ae7b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:16.611357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e820b-a998-4289-8c65-0fc2e4ae7b58 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:16.645256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 839/1684] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:16.655133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac858f6427a47f9b7d51cbfc2a98a50', 'request_id': 'req-c2eef812-e504-4d00-a712-6913de95f397'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:16.676012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac858f6427a47f9b7d51cbfc2a98a50', 'request_id': 'req-c2eef812-e504-4d00-a712-6913de95f397'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:16.820452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac858f6427a47f9b7d51cbfc2a98a50', 'request_id': 'req-c2eef812-e504-4d00-a712-6913de95f397'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:16.843273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] The token cache is being invalidate because project 2ac858f6427a47f9b7d51cbfc2a98a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:16.848220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:16.852218 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c2eef812-e504-4d00-a712-6913de95f397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:16.853308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 846/1685] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:16 2022] DELETE /identity/v3/projects/2ac858f6427a47f9b7d51cbfc2a98a50 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:16.858186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb61c-0e85-4ef4-bc06-d2cf724bf303 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:16.858476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb61c-0e85-4ef4-bc06-d2cf724bf303 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:16.858753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb61c-0e85-4ef4-bc06-d2cf724bf303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:16.900016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-a1cfb61c-0e85-4ef4-bc06-d2cf724bf303 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:16.901252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a1cfb61c-0e85-4ef4-bc06-d2cf724bf303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:17.016514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54493c-4ab6-4122-a97c-e2f09c017571 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:17.016973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54493c-4ab6-4122-a97c-e2f09c017571 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:17.017460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54493c-4ab6-4122-a97c-e2f09c017571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:17.082553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-cd54493c-4ab6-4122-a97c-e2f09c017571 None None] MFA Rules not processed for user `6c831f26a1c344369b050ccf2bc24554`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:17.084783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cd54493c-4ab6-4122-a97c-e2f09c017571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:17.108025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 840/1686] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:17.116370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c41c-ca90-4b5f-9298-7a09509d8f9a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:17.116751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c41c-ca90-4b5f-9298-7a09509d8f9a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:17.117119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c41c-ca90-4b5f-9298-7a09509d8f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:17.179547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9850c41c-ca90-4b5f-9298-7a09509d8f9a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:17.183356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9850c41c-ca90-4b5f-9298-7a09509d8f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:17.211417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 841/1687] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:17.215057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c41c-ca90-4b5f-9298-7a09509d8f9a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:17.237627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c41c-ca90-4b5f-9298-7a09509d8f9a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:17.246528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 847/1688] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:17.250852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d4cf-6955-49be-b8e1-ea2876fe861e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:17.251395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d4cf-6955-49be-b8e1-ea2876fe861e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:17.251830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8d4cf-6955-49be-b8e1-ea2876fe861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:17.262392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798965ee-e9fc-4de0-9c40-252687c80f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:17.263031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798965ee-e9fc-4de0-9c40-252687c80f86 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:17.263353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798965ee-e9fc-4de0-9c40-252687c80f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:17.263631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798965ee-e9fc-4de0-9c40-252687c80f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:17.264303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798965ee-e9fc-4de0-9c40-252687c80f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:17.264607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798965ee-e9fc-4de0-9c40-252687c80f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:17.266444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798965ee-e9fc-4de0-9c40-252687c80f86 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:17.293173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 842/1689] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:17.297895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798965ee-e9fc-4de0-9c40-252687c80f86 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:17.312095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e6a8d4cf-6955-49be-b8e1-ea2876fe861e None None] MFA Rules not processed for user `6c831f26a1c344369b050ccf2bc24554`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:17.314120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e6a8d4cf-6955-49be-b8e1-ea2876fe861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:17.354483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798965ee-e9fc-4de0-9c40-252687c80f86 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:17.359835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 848/1690] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:17.371114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5f1e2-8561-49c9-94df-90c5cbdec2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:17.371790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5f1e2-8561-49c9-94df-90c5cbdec2cd admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:17.372073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5f1e2-8561-49c9-94df-90c5cbdec2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:17.372341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5f1e2-8561-49c9-94df-90c5cbdec2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:17.372831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d4cf-6955-49be-b8e1-ea2876fe861e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:17.372970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5f1e2-8561-49c9-94df-90c5cbdec2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:17.374542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e6a8d4cf-6955-49be-b8e1-ea2876fe861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:17.374900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5f1e2-8561-49c9-94df-90c5cbdec2cd admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:17.555987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 843/1691] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:17 2022] POST /identity/v3/projects => generated 373 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:17.557445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5f1e2-8561-49c9-94df-90c5cbdec2cd admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:17.612872 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8d4cf-6955-49be-b8e1-ea2876fe861e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:17.699711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5f1e2-8561-49c9-94df-90c5cbdec2cd admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:17.706356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d98ff9-72b6-4e5d-a535-24987b9285a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:17.707348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d98ff9-72b6-4e5d-a535-24987b9285a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:17.708763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d98ff9-72b6-4e5d-a535-24987b9285a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:17.711210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d98ff9-72b6-4e5d-a535-24987b9285a0 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:17.712261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d98ff9-72b6-4e5d-a535-24987b9285a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:17.716330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d98ff9-72b6-4e5d-a535-24987b9285a0 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:17.744039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c8e9c-10df-47d5-bfcb-1a2dfcf8209d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:17.744200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8e9c-10df-47d5-bfcb-1a2dfcf8209d service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:17.744467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8e9c-10df-47d5-bfcb-1a2dfcf8209d service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:17.744746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8e9c-10df-47d5-bfcb-1a2dfcf8209d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:17.843951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c8e9c-10df-47d5-bfcb-1a2dfcf8209d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:17.847939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c8e9c-10df-47d5-bfcb-1a2dfcf8209d service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:17.878005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 849/1692] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:17.883372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 844/1693] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:17 2022] POST /identity/v3/users => generated 287 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:17.885304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c8e9c-10df-47d5-bfcb-1a2dfcf8209d service nova] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:17.900070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c8e9c-10df-47d5-bfcb-1a2dfcf8209d service nova] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:17.910594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4355e-9e02-4c05-95c5-c75b5169ed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:17.913587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4355e-9e02-4c05-95c5-c75b5169ed08 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:17.913587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4355e-9e02-4c05-95c5-c75b5169ed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:17.914399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4355e-9e02-4c05-95c5-c75b5169ed08 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:17.915548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4355e-9e02-4c05-95c5-c75b5169ed08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:17.922726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4355e-9e02-4c05-95c5-c75b5169ed08 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:17.938951 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 850/1694] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:17.944543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d98ff9-72b6-4e5d-a535-24987b9285a0 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:17.961970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d98ff9-72b6-4e5d-a535-24987b9285a0 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:17.969253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a5959-fd48-44d9-b9a4-de11ef8d5ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:17.971148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a5959-fd48-44d9-b9a4-de11ef8d5ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:17.971653 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a5959-fd48-44d9-b9a4-de11ef8d5ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:17.972356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a5959-fd48-44d9-b9a4-de11ef8d5ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:17.976702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a5959-fd48-44d9-b9a4-de11ef8d5ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:17.981818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a5959-fd48-44d9-b9a4-de11ef8d5ba4 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:18.023890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 845/1695] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:59:18.028181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4355e-9e02-4c05-95c5-c75b5169ed08 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:18.037996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:18.049370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4355e-9e02-4c05-95c5-c75b5169ed08 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:18.066353 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631166-754e-4a46-952d-42354b33ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:18.067110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631166-754e-4a46-952d-42354b33ac47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:18.067424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631166-754e-4a46-952d-42354b33ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:18.068020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3631166-754e-4a46-952d-42354b33ac47 admin admin] PATH_INFO: `/v3/projects/9cbdca9e41134d1289dbbee02b3c8ca2/users/a433732d654a48e79ceaf045f2779d44/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:18.097804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3631166-754e-4a46-952d-42354b33ac47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbdca9e41134d1289dbbee02b3c8ca2, user_id=a433732d654a48e79ceaf045f2779d44, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:18.103041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3631166-754e-4a46-952d-42354b33ac47 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:18.245008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 851/1696] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:18 2022] PUT /identity/v3/projects/9cbdca9e41134d1289dbbee02b3c8ca2/users/a433732d654a48e79ceaf045f2779d44/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:18.257871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0164d2-bc7f-4c15-9c4d-36859fabe5bb None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:18.258962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0164d2-bc7f-4c15-9c4d-36859fabe5bb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:18.259546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0164d2-bc7f-4c15-9c4d-36859fabe5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:18.283386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631166-754e-4a46-952d-42354b33ac47 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:18.287160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a3631166-754e-4a46-952d-42354b33ac47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:18.342124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:18.353098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ea0164d2-bc7f-4c15-9c4d-36859fabe5bb None None] MFA Rules not processed for user `a433732d654a48e79ceaf045f2779d44`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:18.354611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ea0164d2-bc7f-4c15-9c4d-36859fabe5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:18.516576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3631166-754e-4a46-952d-42354b33ac47 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:18.531171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508712e6-2a15-4f51-a12a-6ae86211b5ab tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebdb863212c4e89bb8b059f709c4005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c3a9153a6a4c21bc6e8824556ca75a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:18.531652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508712e6-2a15-4f51-a12a-6ae86211b5ab tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:18.531946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508712e6-2a15-4f51-a12a-6ae86211b5ab tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:18.532214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508712e6-2a15-4f51-a12a-6ae86211b5ab tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:18.532880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508712e6-2a15-4f51-a12a-6ae86211b5ab tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:18.533345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508712e6-2a15-4f51-a12a-6ae86211b5ab tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:18.548776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508712e6-2a15-4f51-a12a-6ae86211b5ab tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:18.559435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 846/1697] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:18.562790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0164d2-bc7f-4c15-9c4d-36859fabe5bb None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:18.579166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 852/1698] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:59:18.583101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508712e6-2a15-4f51-a12a-6ae86211b5ab tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:18.597001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508712e6-2a15-4f51-a12a-6ae86211b5ab tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:18.628986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838a4c-2530-4f3c-92eb-3bfb13e9668f tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebdb863212c4e89bb8b059f709c4005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c3a9153a6a4c21bc6e8824556ca75a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:18.636032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838a4c-2530-4f3c-92eb-3bfb13e9668f tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:18.636429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838a4c-2530-4f3c-92eb-3bfb13e9668f tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:18.647893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838a4c-2530-4f3c-92eb-3bfb13e9668f tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:18.649386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838a4c-2530-4f3c-92eb-3bfb13e9668f tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:18.658125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838a4c-2530-4f3c-92eb-3bfb13e9668f tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:18.751550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0164d2-bc7f-4c15-9c4d-36859fabe5bb None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:18.762008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584504-2258-4d9f-b0c5-2088d28852d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:18.762849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584504-2258-4d9f-b0c5-2088d28852d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:18.763272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584504-2258-4d9f-b0c5-2088d28852d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:18.763689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584504-2258-4d9f-b0c5-2088d28852d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:18.771661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47584504-2258-4d9f-b0c5-2088d28852d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:18.771661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47584504-2258-4d9f-b0c5-2088d28852d9 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:18.805191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 853/1699] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:18 2022] POST /identity/v3/projects => generated 355 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:18.809449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838a4c-2530-4f3c-92eb-3bfb13e9668f tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:18.931837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 847/1700] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:18 2022] POST /identity/v3/projects => generated 371 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:18.933345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584504-2258-4d9f-b0c5-2088d28852d9 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:18.967668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838a4c-2530-4f3c-92eb-3bfb13e9668f tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:19.166693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37152195-15f4-4938-ba86-d67d5204168d tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebdb863212c4e89bb8b059f709c4005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c3a9153a6a4c21bc6e8824556ca75a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:19.170588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37152195-15f4-4938-ba86-d67d5204168d tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:19.171136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37152195-15f4-4938-ba86-d67d5204168d tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:19.173064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37152195-15f4-4938-ba86-d67d5204168d tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:19.182105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37152195-15f4-4938-ba86-d67d5204168d tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:19.182479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37152195-15f4-4938-ba86-d67d5204168d tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:19.184379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584504-2258-4d9f-b0c5-2088d28852d9 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:19.190402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddac20-0815-4cb9-8dd4-2abaab2c802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:19.191622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddac20-0815-4cb9-8dd4-2abaab2c802d admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:19.191622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddac20-0815-4cb9-8dd4-2abaab2c802d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:19.191622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddac20-0815-4cb9-8dd4-2abaab2c802d admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:19.192211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddac20-0815-4cb9-8dd4-2abaab2c802d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:19.194166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37152195-15f4-4938-ba86-d67d5204168d tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:19.195766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddac20-0815-4cb9-8dd4-2abaab2c802d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:19.221561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 854/1701] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:19.223685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5570583-f463-4adf-aaa7-57e27b2b52f4 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:19.225431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5570583-f463-4adf-aaa7-57e27b2b52f4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:19.226033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5570583-f463-4adf-aaa7-57e27b2b52f4 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:19.235061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 855/1702] 10.222.0.18 () {54 vars in 912 bytes} [Mon Aug 22 19:59:19 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:19.237218 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fbd2-a98c-4048-9f5f-f0074836f457 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:19.237736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fbd2-a98c-4048-9f5f-f0074836f457 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:19.238204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70fbd2-a98c-4048-9f5f-f0074836f457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:19.325075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 848/1703] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:18 2022] POST /identity/v3/users => generated 292 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:19.325075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddac20-0815-4cb9-8dd4-2abaab2c802d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:19.350270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-eb70fbd2-a98c-4048-9f5f-f0074836f457 None None] MFA Rules not processed for user `7500529eff574ca6ae3a9a77d72d2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:19.353210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-eb70fbd2-a98c-4048-9f5f-f0074836f457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:19.354919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddac20-0815-4cb9-8dd4-2abaab2c802d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:19.364437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebdb863212c4e89bb8b059f709c4005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c3a9153a6a4c21bc6e8824556ca75a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:19.366918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:19.367353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:19.367586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] PATH_INFO: `/v3/projects/15247f52a56045bbab2fb55f0a0739f7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:19.372086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Authorizing `identity:delete_project(project_id=15247f52a56045bbab2fb55f0a0739f7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:19.376350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:19.539863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 856/1704] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 19:59:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:19.540902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70fbd2-a98c-4048-9f5f-f0074836f457 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:19.573944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70fbd2-a98c-4048-9f5f-f0074836f457 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:19.607717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15247f52a56045bbab2fb55f0a0739f7', 'request_id': 'req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:19.661038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15247f52a56045bbab2fb55f0a0739f7', 'request_id': 'req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:19.705301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15247f52a56045bbab2fb55f0a0739f7', 'request_id': 'req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:19.765877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f613c60-b31c-43ba-9e69-a1ec5b0ff141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:19.766508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f613c60-b31c-43ba-9e69-a1ec5b0ff141 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:19.766785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f613c60-b31c-43ba-9e69-a1ec5b0ff141 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:19.767055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f613c60-b31c-43ba-9e69-a1ec5b0ff141 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:19.767766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f613c60-b31c-43ba-9e69-a1ec5b0ff141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:19.769440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f613c60-b31c-43ba-9e69-a1ec5b0ff141 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:19.793472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 857/1705] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:19.794777 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f613c60-b31c-43ba-9e69-a1ec5b0ff141 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:19.800665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0f613c60-b31c-43ba-9e69-a1ec5b0ff141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:19.882034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] The token cache is being invalidate because project 15247f52a56045bbab2fb55f0a0739f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:19.888300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:19.897598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:19.900657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 849/1706] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:19 2022] DELETE /identity/v3/projects/15247f52a56045bbab2fb55f0a0739f7 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:19.915169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:19.920664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:19.969815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43daff6e-75b6-4c58-9fb2-83ec9d147dd4 tempest-VolumeQuotaClassesTest-1403935881 tempest-VolumeQuotaClassesTest-1403935881-project-admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:19.981800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097406f-6e2d-42a8-9445-e70887f82fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:19.982688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097406f-6e2d-42a8-9445-e70887f82fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:19.983052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097406f-6e2d-42a8-9445-e70887f82fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:19.983819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097406f-6e2d-42a8-9445-e70887f82fc3 admin admin] PATH_INFO: `/v3/projects/b982570361314278b5b853b9bf309ba3/users/7307a1a11b194aad9aaceb25c134c177/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:20.022523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f613c60-b31c-43ba-9e69-a1ec5b0ff141 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:20.024440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097406f-6e2d-42a8-9445-e70887f82fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b982570361314278b5b853b9bf309ba3, user_id=7307a1a11b194aad9aaceb25c134c177, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:20.033822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097406f-6e2d-42a8-9445-e70887f82fc3 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:20.046036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:20.050630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:20.052216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:20.052713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:20.063183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:20.107781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:20.109759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:20.119728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 858/1707] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:20.139515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 850/1708] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:19 2022] PUT /identity/v3/projects/b982570361314278b5b853b9bf309ba3/users/7307a1a11b194aad9aaceb25c134c177/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:20.141012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:20.143169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097406f-6e2d-42a8-9445-e70887f82fc3 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:20.143875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:20.175098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8559ef-dbaa-42f1-ac39-fba24f601635 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:20.290074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097406f-6e2d-42a8-9445-e70887f82fc3 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:20.303754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2b8e7-f908-445a-95a9-b0b23200f1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:20.304724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2b8e7-f908-445a-95a9-b0b23200f1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:20.305125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2b8e7-f908-445a-95a9-b0b23200f1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:20.305602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2b8e7-f908-445a-95a9-b0b23200f1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:20.306375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2b8e7-f908-445a-95a9-b0b23200f1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:20.311161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2b8e7-f908-445a-95a9-b0b23200f1c5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:20.337683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:20.338543 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:20.338964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:20.339407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] PATH_INFO: `/v3/users/98b43b028a72467fa9f0ed5315fa3ab1` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:20.341832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b43b028a72467fa9f0ed5315fa3ab1)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:20.343926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 851/1709] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:59:20.348678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2b8e7-f908-445a-95a9-b0b23200f1c5 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:20.354093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:20.387598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2b8e7-f908-445a-95a9-b0b23200f1c5 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:20.421933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54444c-8f85-4ecd-943f-da601f8c0dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:20.428012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54444c-8f85-4ecd-943f-da601f8c0dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:20.428617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54444c-8f85-4ecd-943f-da601f8c0dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:20.429063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54444c-8f85-4ecd-943f-da601f8c0dbf admin admin] PATH_INFO: `/v3/projects/b982570361314278b5b853b9bf309ba3/users/7307a1a11b194aad9aaceb25c134c177/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:20.436318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54444c-8f85-4ecd-943f-da601f8c0dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b982570361314278b5b853b9bf309ba3, user_id=7307a1a11b194aad9aaceb25c134c177, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:20.454717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54444c-8f85-4ecd-943f-da601f8c0dbf admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:20.464783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:20.515673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 852/1710] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:20 2022] PUT /identity/v3/projects/b982570361314278b5b853b9bf309ba3/users/7307a1a11b194aad9aaceb25c134c177/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:20.526565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff581ff-8d45-4d3e-8f0e-8bdc6dc09069 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:20.527321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff581ff-8d45-4d3e-8f0e-8bdc6dc09069 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:20.527777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff581ff-8d45-4d3e-8f0e-8bdc6dc09069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:20.616554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-cff581ff-8d45-4d3e-8f0e-8bdc6dc09069 None None] MFA Rules not processed for user `7307a1a11b194aad9aaceb25c134c177`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:20.620093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cff581ff-8d45-4d3e-8f0e-8bdc6dc09069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:20.751432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b43b028a72467fa9f0ed5315fa3ab1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:20.754261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b43b028a72467fa9f0ed5315fa3ab1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:20.835640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 853/1711] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:20.856388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b43b028a72467fa9f0ed5315fa3ab1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:20.868092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b43b028a72467fa9f0ed5315fa3ab1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:20.888749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b43b028a72467fa9f0ed5315fa3ab1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:20.898808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 859/1712] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:20 2022] DELETE /identity/v3/users/98b43b028a72467fa9f0ed5315fa3ab1 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:20.903617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc130f-0ac4-4403-9eab-6f4b63279728 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:20.903980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc130f-0ac4-4403-9eab-6f4b63279728 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:20.904331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc130f-0ac4-4403-9eab-6f4b63279728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:20.917440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:20.930947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-89bc130f-0ac4-4403-9eab-6f4b63279728 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:20.932330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-89bc130f-0ac4-4403-9eab-6f4b63279728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:21.016994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:21.018996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:21.023688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 854/1713] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:21.034889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc130f-0ac4-4403-9eab-6f4b63279728 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:21.038560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-89bc130f-0ac4-4403-9eab-6f4b63279728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:21.211834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53eea6-1531-474d-b333-a1871a58f036 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:21.237677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a6b2b-be65-43b2-bc32-89da6bc67a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:21.238341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a6b2b-be65-43b2-bc32-89da6bc67a9e service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:21.238620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a6b2b-be65-43b2-bc32-89da6bc67a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:21.238890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a6b2b-be65-43b2-bc32-89da6bc67a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:21.252374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc130f-0ac4-4403-9eab-6f4b63279728 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:21.262589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a550-6c42-436b-a185-8ba7785b97ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:21.263261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a550-6c42-436b-a185-8ba7785b97ff service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:21.263545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a550-6c42-436b-a185-8ba7785b97ff service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:21.263814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a550-6c42-436b-a185-8ba7785b97ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:21.307064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5a550-6c42-436b-a185-8ba7785b97ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:21.316249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5a550-6c42-436b-a185-8ba7785b97ff service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:21.335343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:21.357416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 855/1714] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:21.358975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a550-6c42-436b-a185-8ba7785b97ff service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:21.366043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-88d5a550-6c42-436b-a185-8ba7785b97ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:21.423064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a550-6c42-436b-a185-8ba7785b97ff service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:21.441026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:21.442112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:21.444893 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:21.445543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] PATH_INFO: `/v3/users/a79a5450e2eb4c228169e4ed62319251` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:21.449504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79a5450e2eb4c228169e4ed62319251)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:21.450703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a6b2b-be65-43b2-bc32-89da6bc67a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:21.482005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a6b2b-be65-43b2-bc32-89da6bc67a9e service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:21.485820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:21.514291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 860/1715] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:21.540334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919db636-045c-40bb-aad0-c93995296b2a None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:21.540543 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919db636-045c-40bb-aad0-c93995296b2a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:21.545887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919db636-045c-40bb-aad0-c93995296b2a None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:21.557811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 861/1716] 10.222.0.18 () {54 vars in 961 bytes} [Mon Aug 22 19:59:21 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:21.560458 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab98d-c520-442e-94f2-b6aa5f250ea4 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:21.564227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab98d-c520-442e-94f2-b6aa5f250ea4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:21.564695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab98d-c520-442e-94f2-b6aa5f250ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:21.618889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:21.636669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-af9ab98d-c520-442e-94f2-b6aa5f250ea4 None None] MFA Rules not processed for user `e395d0436d2443f5a6e55e137d375549`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:21.638256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-af9ab98d-c520-442e-94f2-b6aa5f250ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:21.787366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 862/1717] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:21.787366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545f41-e852-4f64-bef6-fd393ed128fd None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:21.787366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545f41-e852-4f64-bef6-fd393ed128fd None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:21.787366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75545f41-e852-4f64-bef6-fd393ed128fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:21.807805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79a5450e2eb4c228169e4ed62319251'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:21.809057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79a5450e2eb4c228169e4ed62319251'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:21.831828 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79a5450e2eb4c228169e4ed62319251'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:21.841261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-75545f41-e852-4f64-bef6-fd393ed128fd None None] MFA Rules not processed for user `e6d3fd0d74c94f88aef2f0be0047ee9a`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:21.843054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-75545f41-e852-4f64-bef6-fd393ed128fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:21.960640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 863/1718] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:21.966982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aa182-bcd0-405b-a48d-ddd29138a827 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:21.967295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aa182-bcd0-405b-a48d-ddd29138a827 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:21.967573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24aa182-bcd0-405b-a48d-ddd29138a827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:21.995695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79a5450e2eb4c228169e4ed62319251'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:22.006275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e24aa182-bcd0-405b-a48d-ddd29138a827 None None] MFA Rules not processed for user `1ef51739456e4beb9ae0f107b13d55f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:22.007811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e24aa182-bcd0-405b-a48d-ddd29138a827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:22.033910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79a5450e2eb4c228169e4ed62319251'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:22.066050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 856/1719] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:21 2022] DELETE /identity/v3/users/a79a5450e2eb4c228169e4ed62319251 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:22.067403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:22.074881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:22.160439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 864/1720] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Aug 22 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:22.162585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24aa182-bcd0-405b-a48d-ddd29138a827 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:22.165403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e24aa182-bcd0-405b-a48d-ddd29138a827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:22.283480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551c762-e5bf-4a00-9db0-ef170b771ff2 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:22.296196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24aa182-bcd0-405b-a48d-ddd29138a827 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:22.297506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573854f-0a86-48ed-93c9-6538c6de2eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:22.298329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573854f-0a86-48ed-93c9-6538c6de2eff service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:22.298525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6436c-2b4b-45ac-a7ab-27cc035b76f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:22.298913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573854f-0a86-48ed-93c9-6538c6de2eff service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:22.299362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573854f-0a86-48ed-93c9-6538c6de2eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:22.299469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6436c-2b4b-45ac-a7ab-27cc035b76f9 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:22.300051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6436c-2b4b-45ac-a7ab-27cc035b76f9 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:22.301050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6436c-2b4b-45ac-a7ab-27cc035b76f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:22.305556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e573854f-0a86-48ed-93c9-6538c6de2eff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:22.450172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6436c-2b4b-45ac-a7ab-27cc035b76f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:22.452094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6436c-2b4b-45ac-a7ab-27cc035b76f9 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:22.464560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573854f-0a86-48ed-93c9-6538c6de2eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:22.468441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 865/1721] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:22.470009 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6016-87b6-4e14-8471-43a60c343fa0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:22.470417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6016-87b6-4e14-8471-43a60c343fa0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:22.471567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f6016-87b6-4e14-8471-43a60c343fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:22.492489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573854f-0a86-48ed-93c9-6538c6de2eff service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:22.496570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ac9f6016-87b6-4e14-8471-43a60c343fa0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:22.498183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ac9f6016-87b6-4e14-8471-43a60c343fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:22.528478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 857/1722] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:22.529954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573854f-0a86-48ed-93c9-6538c6de2eff service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:22.546455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:22.588691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 866/1723] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:22.588691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f6016-87b6-4e14-8471-43a60c343fa0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:22.588691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ac9f6016-87b6-4e14-8471-43a60c343fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:22.603680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f6016-87b6-4e14-8471-43a60c343fa0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:22.613525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:22.616833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:22.617773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:22.618343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] PATH_INFO: `/v3/projects/624047ed3c4741d4a7d31c4135f09317` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:22.620584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624047ed3c4741d4a7d31c4135f09317)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:22.627026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:22.700090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573854f-0a86-48ed-93c9-6538c6de2eff service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:22.720723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:22.722134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:22.724174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:22.745808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:22.754041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:22.826877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624047ed3c4741d4a7d31c4135f09317', 'request_id': 'req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:22.830723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:22.834442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:22.842842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624047ed3c4741d4a7d31c4135f09317', 'request_id': 'req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:22.853708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 858/1724] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:22.855312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:22.864338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:22.938545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624047ed3c4741d4a7d31c4135f09317', 'request_id': 'req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:22.960459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] The token cache is being invalidate because project 624047ed3c4741d4a7d31c4135f09317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:22.960459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:22.960459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-42becbb1-e73a-49c9-ac7f-4ebf4d493bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:22.962200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 867/1725] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:22 2022] DELETE /identity/v3/projects/624047ed3c4741d4a7d31c4135f09317 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:22.969256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0686bf-ee62-4b23-8964-10dddccc02e9 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:22.969256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0686bf-ee62-4b23-8964-10dddccc02e9 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:22.969256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0686bf-ee62-4b23-8964-10dddccc02e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:22.969508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa687a-d04d-4210-81b9-9478ed06d902 service placement] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:23.006747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:23.034806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8a0686bf-ee62-4b23-8964-10dddccc02e9 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:23.038678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8a0686bf-ee62-4b23-8964-10dddccc02e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:23.217992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 868/1726] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:23.223109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0150a-c8a3-4c29-8a0e-a7a07821f2f5 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:23.225351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0150a-c8a3-4c29-8a0e-a7a07821f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:23.225673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0150a-c8a3-4c29-8a0e-a7a07821f2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:23.226114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:23.227075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e513c-b81c-464d-9490-4eda25bbc6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:23.228137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e513c-b81c-464d-9490-4eda25bbc6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:23.228717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e513c-b81c-464d-9490-4eda25bbc6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:23.229234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e513c-b81c-464d-9490-4eda25bbc6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:23.233938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4f6e513c-b81c-464d-9490-4eda25bbc6e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:23.281507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e513c-b81c-464d-9490-4eda25bbc6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:23.288723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e513c-b81c-464d-9490-4eda25bbc6e2 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:23.290999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f1a0150a-c8a3-4c29-8a0e-a7a07821f2f5 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:23.296262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f1a0150a-c8a3-4c29-8a0e-a7a07821f2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:23.320692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 859/1727] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:23.321439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 869/1728] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:23.325927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e513c-b81c-464d-9490-4eda25bbc6e2 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:23.339608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e513c-b81c-464d-9490-4eda25bbc6e2 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:23.355485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:23.355485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:23.355485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:23.355485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:23.355935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:23.355935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:23.355935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:23.387046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 860/1729] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:23.387518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0150a-c8a3-4c29-8a0e-a7a07821f2f5 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:23.407452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0150a-c8a3-4c29-8a0e-a7a07821f2f5 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:23.412457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:23.415502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:23.428461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cf319-00af-47ad-bf9b-1eece69f0321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:23.429655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cf319-00af-47ad-bf9b-1eece69f0321 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:23.432810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cf319-00af-47ad-bf9b-1eece69f0321 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:23.435802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cf319-00af-47ad-bf9b-1eece69f0321 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:23.435802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cf319-00af-47ad-bf9b-1eece69f0321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:23.436708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cf319-00af-47ad-bf9b-1eece69f0321 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:23.484669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a466-c55f-4f1c-b135-aabdd4dd07a5 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:23.499431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:23.506927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:23.507895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:23.509050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] PATH_INFO: `/v3/users/a433732d654a48e79ceaf045f2779d44` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:23.512110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a433732d654a48e79ceaf045f2779d44)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:23.516571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:23.629069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 870/1730] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:23 2022] POST /identity/v3/projects => generated 365 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:23.633633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cf319-00af-47ad-bf9b-1eece69f0321 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:23.858569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a433732d654a48e79ceaf045f2779d44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:23.863067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a433732d654a48e79ceaf045f2779d44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:23.865059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cf319-00af-47ad-bf9b-1eece69f0321 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:23.873809 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f5481-2d15-4c1a-b52d-c5e1a015ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:23.874891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f5481-2d15-4c1a-b52d-c5e1a015ec2b admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:23.875315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f5481-2d15-4c1a-b52d-c5e1a015ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:23.875676 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f5481-2d15-4c1a-b52d-c5e1a015ec2b admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:23.876471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f5481-2d15-4c1a-b52d-c5e1a015ec2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:23.879549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f5481-2d15-4c1a-b52d-c5e1a015ec2b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:23.921973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a433732d654a48e79ceaf045f2779d44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:24.035008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 871/1731] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:23 2022] POST /identity/v3/users => generated 283 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:59:24.050195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f5481-2d15-4c1a-b52d-c5e1a015ec2b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:24.055750 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a433732d654a48e79ceaf045f2779d44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:24.055850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bd5f5481-2d15-4c1a-b52d-c5e1a015ec2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:24.075048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f5481-2d15-4c1a-b52d-c5e1a015ec2b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:24.081137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd7be0-8ad1-484b-8f7a-9e7b25164d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:24.082588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd7be0-8ad1-484b-8f7a-9e7b25164d1d admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:24.082946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd7be0-8ad1-484b-8f7a-9e7b25164d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:24.088383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a89bd9e7-98f3-4879-8fe1-5b861d5a2881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a433732d654a48e79ceaf045f2779d44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:24.088548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd7be0-8ad1-484b-8f7a-9e7b25164d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:24.088548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd7be0-8ad1-484b-8f7a-9e7b25164d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:24.088548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd7be0-8ad1-484b-8f7a-9e7b25164d1d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:24.101557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 872/1732] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:24.105140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 861/1733] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:23 2022] DELETE /identity/v3/users/a433732d654a48e79ceaf045f2779d44 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:24.107058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd7be0-8ad1-484b-8f7a-9e7b25164d1d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:24.109606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3e7c9-3125-4020-bbf1-1f177bc8c3b1 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:24.110053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3e7c9-3125-4020-bbf1-1f177bc8c3b1 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:24.110600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3e7c9-3125-4020-bbf1-1f177bc8c3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:24.133058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd7be0-8ad1-484b-8f7a-9e7b25164d1d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:24.155247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e9c3e7c9-3125-4020-bbf1-1f177bc8c3b1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:24.156486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e9c3e7c9-3125-4020-bbf1-1f177bc8c3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:24.280999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2dee8-5835-46c7-9e61-471ea7d3a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:24.281968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2dee8-5835-46c7-9e61-471ea7d3a317 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:24.282351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2dee8-5835-46c7-9e61-471ea7d3a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:24.282721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2dee8-5835-46c7-9e61-471ea7d3a317 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:24.283509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2dee8-5835-46c7-9e61-471ea7d3a317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:24.285256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2dee8-5835-46c7-9e61-471ea7d3a317 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:24.325832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 873/1734] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:24.330247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12f515-f9d3-46c4-85c4-7dd482f90cea None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:24.332748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12f515-f9d3-46c4-85c4-7dd482f90cea None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:24.333695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12f515-f9d3-46c4-85c4-7dd482f90cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:24.362947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 862/1735] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:24.364242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3e7c9-3125-4020-bbf1-1f177bc8c3b1 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:24.376615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3e7c9-3125-4020-bbf1-1f177bc8c3b1 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:24.386083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aabe3-7e7a-4a0f-aea3-02b68ef6d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:24.387397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aabe3-7e7a-4a0f-aea3-02b68ef6d5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:24.387907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aabe3-7e7a-4a0f-aea3-02b68ef6d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:24.388332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aabe3-7e7a-4a0f-aea3-02b68ef6d5b7 admin admin] PATH_INFO: `/v3/projects/c949434e62e04a22a938842f0eb74c16/users/1d9f345690444259967f7822e5433410/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:24.401549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-bf12f515-f9d3-46c4-85c4-7dd482f90cea None None] MFA Rules not processed for user `49fc8627822f4765b08db422e7e580df`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:24.402807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bf12f515-f9d3-46c4-85c4-7dd482f90cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:24.433375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aabe3-7e7a-4a0f-aea3-02b68ef6d5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c949434e62e04a22a938842f0eb74c16, user_id=1d9f345690444259967f7822e5433410, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:24.440325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aabe3-7e7a-4a0f-aea3-02b68ef6d5b7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:24.566501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 863/1736] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:24 2022] PUT /identity/v3/projects/c949434e62e04a22a938842f0eb74c16/users/1d9f345690444259967f7822e5433410/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:24.571815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aabe3-7e7a-4a0f-aea3-02b68ef6d5b7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:24.580249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:24.584586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b11aabe3-7e7a-4a0f-aea3-02b68ef6d5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:24.626375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 874/1737] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:24.630182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176181-1f49-4d4a-b5ba-7a47faed1c8c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:24.631617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176181-1f49-4d4a-b5ba-7a47faed1c8c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:24.631617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec176181-1f49-4d4a-b5ba-7a47faed1c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:24.718903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ec176181-1f49-4d4a-b5ba-7a47faed1c8c None None] MFA Rules not processed for user `1d9f345690444259967f7822e5433410`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:24.722357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ec176181-1f49-4d4a-b5ba-7a47faed1c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:24.783376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aabe3-7e7a-4a0f-aea3-02b68ef6d5b7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:24.798445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901b79f-6d24-43a4-a607-1a1aaa833646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:24.799086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901b79f-6d24-43a4-a607-1a1aaa833646 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:24.802876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901b79f-6d24-43a4-a607-1a1aaa833646 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:24.803539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901b79f-6d24-43a4-a607-1a1aaa833646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:24.891217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 875/1738] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:24.892999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de831c-97cb-4198-a82d-271f0b061815 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:24.897278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de831c-97cb-4198-a82d-271f0b061815 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:24.897627 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de831c-97cb-4198-a82d-271f0b061815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:24.950462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901b79f-6d24-43a4-a607-1a1aaa833646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:24.955532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901b79f-6d24-43a4-a607-1a1aaa833646 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:24.968299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-63de831c-97cb-4198-a82d-271f0b061815 None None] MFA Rules not processed for user `49fc8627822f4765b08db422e7e580df`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:24.974680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-63de831c-97cb-4198-a82d-271f0b061815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:24.979543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 864/1739] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:24.982745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901b79f-6d24-43a4-a607-1a1aaa833646 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:25.006833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901b79f-6d24-43a4-a607-1a1aaa833646 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:25.021414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5307a-89e4-4ee8-b3f6-60c5c8803542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:25.022297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5307a-89e4-4ee8-b3f6-60c5c8803542 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:25.022723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5307a-89e4-4ee8-b3f6-60c5c8803542 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:25.022998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5307a-89e4-4ee8-b3f6-60c5c8803542 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:25.023722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5307a-89e4-4ee8-b3f6-60c5c8803542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:25.025757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5307a-89e4-4ee8-b3f6-60c5c8803542 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:25.029682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:25.131109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 876/1740] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:25.131109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de831c-97cb-4198-a82d-271f0b061815 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:25.131790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-63de831c-97cb-4198-a82d-271f0b061815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:25.148502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de831c-97cb-4198-a82d-271f0b061815 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:25.185685 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 865/1741] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:24 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:25.186932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5307a-89e4-4ee8-b3f6-60c5c8803542 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:25.187867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:25.190806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:25.191084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:25.195419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] PATH_INFO: `/v3/projects/94c4be7105324236b1d67d242e700937` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:25.195871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2fe5307a-89e4-4ee8-b3f6-60c5c8803542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:25.198578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c4be7105324236b1d67d242e700937)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:25.207335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:25.389875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5307a-89e4-4ee8-b3f6-60c5c8803542 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:25.395518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c4be7105324236b1d67d242e700937', 'request_id': 'req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:25.411011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c4be7105324236b1d67d242e700937', 'request_id': 'req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:25.523926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c4be7105324236b1d67d242e700937', 'request_id': 'req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:25.551825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] The token cache is being invalidate because project 94c4be7105324236b1d67d242e700937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:25.552202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:25.556038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:25.557757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 877/1742] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:25 2022] DELETE /identity/v3/projects/94c4be7105324236b1d67d242e700937 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:25.558653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:25.574646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:25.750254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea57ad-2ac9-4ff9-bb88-581657ecd0ea admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:25.752865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:25.779033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a611a-5663-4a81-8fce-d0170e121d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:25.781580 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a611a-5663-4a81-8fce-d0170e121d5d admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:25.781839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a611a-5663-4a81-8fce-d0170e121d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:25.782476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:25.784502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a611a-5663-4a81-8fce-d0170e121d5d admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:25.784502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a611a-5663-4a81-8fce-d0170e121d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:25.785618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a611a-5663-4a81-8fce-d0170e121d5d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:25.789377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:25.792498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:25.809835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:25.941838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:25.944378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:25.951987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 878/1743] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:25 2022] POST /identity/v3/users => generated 289 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:25.953681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a611a-5663-4a81-8fce-d0170e121d5d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:25.960214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-079a611a-5663-4a81-8fce-d0170e121d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:25.960396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 866/1744] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:25.961267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:25.962680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:25.976244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:25.993926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a611a-5663-4a81-8fce-d0170e121d5d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:26.009279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:26.009929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:26.010325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:26.011380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] PATH_INFO: `/v3/users/d33064c090fc42eaafdbcd412be7eb1f` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:26.014365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d002c-4d6a-43d1-a81f-54abe01074c3 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:26.014606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33064c090fc42eaafdbcd412be7eb1f)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:26.022566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:26.024038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:26.024697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:26.025058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:26.027581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] PATH_INFO: `/v3/users/3ebdb863212c4e89bb8b059f709c4005` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:26.030693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebdb863212c4e89bb8b059f709c4005)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:26.033243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:26.306658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33064c090fc42eaafdbcd412be7eb1f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.308811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33064c090fc42eaafdbcd412be7eb1f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.315843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebdb863212c4e89bb8b059f709c4005'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.323958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebdb863212c4e89bb8b059f709c4005'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.332753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebdb863212c4e89bb8b059f709c4005'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.423468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33064c090fc42eaafdbcd412be7eb1f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.434358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33064c090fc42eaafdbcd412be7eb1f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.455406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33064c090fc42eaafdbcd412be7eb1f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.466141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 879/1745] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:25 2022] DELETE /identity/v3/users/d33064c090fc42eaafdbcd412be7eb1f => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:26.467093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:26.469895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:26.520432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebdb863212c4e89bb8b059f709c4005'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.585764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebdb863212c4e89bb8b059f709c4005'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:26.616130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 867/1746] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:25 2022] DELETE /identity/v3/users/3ebdb863212c4e89bb8b059f709c4005 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:26.617425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:26.627142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:26.741033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518ef9f-d65b-406d-b017-6c697637c724 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:26.807821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712c304-4ada-462a-a9f1-f8bc90146482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:26.808568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712c304-4ada-462a-a9f1-f8bc90146482 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:26.808850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712c304-4ada-462a-a9f1-f8bc90146482 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:26.809264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712c304-4ada-462a-a9f1-f8bc90146482 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:26.809945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712c304-4ada-462a-a9f1-f8bc90146482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:26.811698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712c304-4ada-462a-a9f1-f8bc90146482 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:26.827184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 880/1747] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:26.828657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0e5e-b941-44f6-a92c-3f2fc35c2098 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:26.828938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0e5e-b941-44f6-a92c-3f2fc35c2098 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:26.829210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0e5e-b941-44f6-a92c-3f2fc35c2098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:26.836166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:26.855709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ef034-a12d-46d7-9c90-341799416a6d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:26.857922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-dc1b0e5e-b941-44f6-a92c-3f2fc35c2098 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:26.864606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dc1b0e5e-b941-44f6-a92c-3f2fc35c2098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:26.872319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:26.872983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:26.873255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:26.873549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] PATH_INFO: `/v3/projects/9cbdca9e41134d1289dbbee02b3c8ca2` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:26.875597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cbdca9e41134d1289dbbee02b3c8ca2)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:26.881938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 881/1748] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:26.881938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b0e5e-b941-44f6-a92c-3f2fc35c2098 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:26.883120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:26.884624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dc1b0e5e-b941-44f6-a92c-3f2fc35c2098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:26.915995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b0e5e-b941-44f6-a92c-3f2fc35c2098 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:26.930524 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6328-bd79-49c2-96f7-a90f39418741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:26.931277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6328-bd79-49c2-96f7-a90f39418741 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:26.931576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6328-bd79-49c2-96f7-a90f39418741 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:26.932053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6328-bd79-49c2-96f7-a90f39418741 admin admin] PATH_INFO: `/v3/projects/cda4a5383ed6419eb31baaa8b625a34b/users/59300690254b4ae19e04e8be8e888c9d/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:26.970642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6328-bd79-49c2-96f7-a90f39418741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda4a5383ed6419eb31baaa8b625a34b, user_id=59300690254b4ae19e04e8be8e888c9d, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:26.986077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6328-bd79-49c2-96f7-a90f39418741 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:27.109730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:27.116512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 882/1749] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:26 2022] PUT /identity/v3/projects/cda4a5383ed6419eb31baaa8b625a34b/users/59300690254b4ae19e04e8be8e888c9d/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:27.120630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6328-bd79-49c2-96f7-a90f39418741 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:27.124788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5e8c6328-bd79-49c2-96f7-a90f39418741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:27.131847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cbdca9e41134d1289dbbee02b3c8ca2', 'request_id': 'req-d64591fc-5d91-4863-be86-82e2c0b582eb'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:27.144563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cbdca9e41134d1289dbbee02b3c8ca2', 'request_id': 'req-d64591fc-5d91-4863-be86-82e2c0b582eb'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:27.157298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cbdca9e41134d1289dbbee02b3c8ca2', 'request_id': 'req-d64591fc-5d91-4863-be86-82e2c0b582eb'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:27.216702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6328-bd79-49c2-96f7-a90f39418741 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:27.267642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] The token cache is being invalidate because project 9cbdca9e41134d1289dbbee02b3c8ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:27.269116 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:27.271735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:27.274073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 868/1750] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:26 2022] DELETE /identity/v3/projects/9cbdca9e41134d1289dbbee02b3c8ca2 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:27.275693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:27.279001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:27.295656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:27.296459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:27.296879 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:27.300342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:27.300342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:27.469797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:27.473127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:27.480801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64591fc-5d91-4863-be86-82e2c0b582eb admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:27.487944 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691a050-0f0a-4731-b2f2-aa61447be259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:27.488804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691a050-0f0a-4731-b2f2-aa61447be259 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:27.488922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691a050-0f0a-4731-b2f2-aa61447be259 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:27.489102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691a050-0f0a-4731-b2f2-aa61447be259 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:27.490809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691a050-0f0a-4731-b2f2-aa61447be259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:27.493679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691a050-0f0a-4731-b2f2-aa61447be259 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:27.500846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 883/1751] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:27.503736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:27.509424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 869/1752] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:27.509592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:27.511755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691a050-0f0a-4731-b2f2-aa61447be259 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:27.537481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691a050-0f0a-4731-b2f2-aa61447be259 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:27.565867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8844e2-eab8-44f0-af9f-93fa48118459 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:27.569933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:27.576488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6af7fa-1181-4c80-a4fa-b595a52b8797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:27.577190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af7fa-1181-4c80-a4fa-b595a52b8797 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:27.580159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af7fa-1181-4c80-a4fa-b595a52b8797 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:27.580433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6af7fa-1181-4c80-a4fa-b595a52b8797 admin admin] PATH_INFO: `/v3/projects/cda4a5383ed6419eb31baaa8b625a34b/users/59300690254b4ae19e04e8be8e888c9d/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:27.586725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:27.589087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:27.591521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af7fa-1181-4c80-a4fa-b595a52b8797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda4a5383ed6419eb31baaa8b625a34b, user_id=59300690254b4ae19e04e8be8e888c9d, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:27.592818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:27.593164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] PATH_INFO: `/v3/users/7307a1a11b194aad9aaceb25c134c177` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:27.596937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7307a1a11b194aad9aaceb25c134c177)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:27.602939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6af7fa-1181-4c80-a4fa-b595a52b8797 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:27.606256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:27.654771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 870/1753] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:27 2022] PUT /identity/v3/projects/cda4a5383ed6419eb31baaa8b625a34b/users/59300690254b4ae19e04e8be8e888c9d/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:27.656599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23f9a4-336e-452b-9c3f-2651c8f503e3 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:27.656888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23f9a4-336e-452b-9c3f-2651c8f503e3 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:27.657662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23f9a4-336e-452b-9c3f-2651c8f503e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:27.708095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ed23f9a4-336e-452b-9c3f-2651c8f503e3 None None] MFA Rules not processed for user `59300690254b4ae19e04e8be8e888c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:27.711703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ed23f9a4-336e-452b-9c3f-2651c8f503e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:27.904598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 871/1754] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:27.918899 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7307a1a11b194aad9aaceb25c134c177'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:27.922069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7307a1a11b194aad9aaceb25c134c177'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:27.928132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23f9a4-336e-452b-9c3f-2651c8f503e3 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:27.931078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ed23f9a4-336e-452b-9c3f-2651c8f503e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:28.023170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7307a1a11b194aad9aaceb25c134c177'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:28.032412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7307a1a11b194aad9aaceb25c134c177'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:28.104042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7307a1a11b194aad9aaceb25c134c177'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:28.118078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23f9a4-336e-452b-9c3f-2651c8f503e3 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:28.122925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 884/1755] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:27 2022] DELETE /identity/v3/users/7307a1a11b194aad9aaceb25c134c177 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:28.304589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:28.308597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:28.360522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:28.361218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:28.361493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:28.361824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:28.372140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:28.620766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba0424-32e6-46d9-9c66-73e95477e45a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:28.623891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:28.625813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:28.634558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:28.635259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:28.635584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:28.635830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] PATH_INFO: `/v3/projects/38c3a9153a6a4c21bc6e8824556ca75a` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:28.637282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c3a9153a6a4c21bc6e8824556ca75a)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:28.640073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:28.649610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 872/1756] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:28.870820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c3a9153a6a4c21bc6e8824556ca75a', 'request_id': 'req-95692e09-f748-4fe2-89f3-7f904e9eb0ef'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:28.892057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c3a9153a6a4c21bc6e8824556ca75a', 'request_id': 'req-95692e09-f748-4fe2-89f3-7f904e9eb0ef'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:28.936151 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:28.966406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c3a9153a6a4c21bc6e8824556ca75a', 'request_id': 'req-95692e09-f748-4fe2-89f3-7f904e9eb0ef'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:28.989850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:28.992885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:29.002396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] The token cache is being invalidate because project 38c3a9153a6a4c21bc6e8824556ca75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:29.010222 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:29.012406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-95692e09-f748-4fe2-89f3-7f904e9eb0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:29.015516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 885/1757] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:28 2022] DELETE /identity/v3/projects/38c3a9153a6a4c21bc6e8824556ca75a => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:29.020428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98cd77-724f-46aa-85a4-c35f05ba5676 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:29.021248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98cd77-724f-46aa-85a4-c35f05ba5676 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:29.021388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0d780-3cb4-4d02-aecb-398ce233a394 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:29.022120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98cd77-724f-46aa-85a4-c35f05ba5676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:29.085239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-1c98cd77-724f-46aa-85a4-c35f05ba5676 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:29.095374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1c98cd77-724f-46aa-85a4-c35f05ba5676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:29.181241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16579e5-d7c3-4730-b31a-d58eab61bc43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:29.188820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16579e5-d7c3-4730-b31a-d58eab61bc43 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:29.190855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16579e5-d7c3-4730-b31a-d58eab61bc43 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:29.193394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16579e5-d7c3-4730-b31a-d58eab61bc43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:29.199455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d16579e5-d7c3-4730-b31a-d58eab61bc43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:29.219738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 886/1758] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:29.222670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299d61-e7ad-4a8e-a78b-ce529439c24e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:29.222955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299d61-e7ad-4a8e-a78b-ce529439c24e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:29.223273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299d61-e7ad-4a8e-a78b-ce529439c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:29.311551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16579e5-d7c3-4730-b31a-d58eab61bc43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:29.314675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16579e5-d7c3-4730-b31a-d58eab61bc43 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:29.330463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 873/1759] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:29.346114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e1299d61-e7ad-4a8e-a78b-ce529439c24e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:29.348176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e1299d61-e7ad-4a8e-a78b-ce529439c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:29.377248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829aff-c8be-433e-aea5-046da88d0762 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:29.380984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829aff-c8be-433e-aea5-046da88d0762 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:29.382212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829aff-c8be-433e-aea5-046da88d0762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:29.387169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 887/1760] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:29.390514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299d61-e7ad-4a8e-a78b-ce529439c24e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:29.419929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299d61-e7ad-4a8e-a78b-ce529439c24e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:29.436271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89628d-19c5-4ec7-9c7e-0b6fbc93d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:29.437151 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89628d-19c5-4ec7-9c7e-0b6fbc93d5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:29.437435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89628d-19c5-4ec7-9c7e-0b6fbc93d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:29.437697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89628d-19c5-4ec7-9c7e-0b6fbc93d5b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:29.445011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89628d-19c5-4ec7-9c7e-0b6fbc93d5b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:29.445530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89628d-19c5-4ec7-9c7e-0b6fbc93d5b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:29.450864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89628d-19c5-4ec7-9c7e-0b6fbc93d5b6 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:29.488083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 888/1761] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:29.490551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0cd13-c502-4532-9c0e-b6ac24f03c5f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:29.490989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0cd13-c502-4532-9c0e-b6ac24f03c5f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:29.491507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0cd13-c502-4532-9c0e-b6ac24f03c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:29.561256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6b829aff-c8be-433e-aea5-046da88d0762 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:29.562758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6b829aff-c8be-433e-aea5-046da88d0762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:29.566360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-68c0cd13-c502-4532-9c0e-b6ac24f03c5f None None] MFA Rules not processed for user `49fc8627822f4765b08db422e7e580df`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:29.569775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-68c0cd13-c502-4532-9c0e-b6ac24f03c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:29.674542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 874/1762] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 19:59:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:29.675515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b829aff-c8be-433e-aea5-046da88d0762 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:29.693563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b829aff-c8be-433e-aea5-046da88d0762 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:29.700851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dad20-8e57-47c7-ac67-40eec0f86f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:29.701737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dad20-8e57-47c7-ac67-40eec0f86f6d admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:29.701870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dad20-8e57-47c7-ac67-40eec0f86f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:29.702149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dad20-8e57-47c7-ac67-40eec0f86f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:29.702939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dad20-8e57-47c7-ac67-40eec0f86f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:29.706062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dad20-8e57-47c7-ac67-40eec0f86f6d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:29.722152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 889/1763] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:29.766247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0cd13-c502-4532-9c0e-b6ac24f03c5f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:29.769096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:29.771349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-68c0cd13-c502-4532-9c0e-b6ac24f03c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:29.802864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0cd13-c502-4532-9c0e-b6ac24f03c5f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:29.826380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:29.827118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:29.827334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:29.827612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] PATH_INFO: `/v3/projects/b982570361314278b5b853b9bf309ba3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:29.830239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b982570361314278b5b853b9bf309ba3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:29.836873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:29.878528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 875/1764] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:29 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:29.881660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dad20-8e57-47c7-ac67-40eec0f86f6d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:29.886397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7a2dad20-8e57-47c7-ac67-40eec0f86f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:29.899347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:30.007261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dad20-8e57-47c7-ac67-40eec0f86f6d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:30.012079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b982570361314278b5b853b9bf309ba3', 'request_id': 'req-40dcd855-954b-491a-9344-3ed5ec25a1c9'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.020137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b982570361314278b5b853b9bf309ba3', 'request_id': 'req-40dcd855-954b-491a-9344-3ed5ec25a1c9'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.139835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:30.140495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:30.141778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:30.142111 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] PATH_INFO: `/v3/projects/1f05ef93b4984d009c26553254d98e92` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:30.144842 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f05ef93b4984d009c26553254d98e92)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:30.154916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:30.155123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b982570361314278b5b853b9bf309ba3', 'request_id': 'req-40dcd855-954b-491a-9344-3ed5ec25a1c9'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.173518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] The token cache is being invalidate because project b982570361314278b5b853b9bf309ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:30.177336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.179658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.182108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 890/1765] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:29 2022] DELETE /identity/v3/projects/b982570361314278b5b853b9bf309ba3 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:30.182907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:30.187980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:30.207845 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd855-954b-491a-9344-3ed5ec25a1c9 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:30.215072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94af1f-f2e3-477e-a822-a3dd6a06002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:30.216190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94af1f-f2e3-477e-a822-a3dd6a06002c admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:30.219390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94af1f-f2e3-477e-a822-a3dd6a06002c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:30.219390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94af1f-f2e3-477e-a822-a3dd6a06002c admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:30.219390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94af1f-f2e3-477e-a822-a3dd6a06002c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:30.219708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94af1f-f2e3-477e-a822-a3dd6a06002c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:30.354633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f05ef93b4984d009c26553254d98e92', 'request_id': 'req-a3e50725-6060-4877-b433-2f4d48d63a36'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.370487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f05ef93b4984d009c26553254d98e92', 'request_id': 'req-a3e50725-6060-4877-b433-2f4d48d63a36'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.377618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 891/1766] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:30 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:30.381314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6fca4-4f62-4ec0-a013-caa579f95887 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:30.381875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6fca4-4f62-4ec0-a013-caa579f95887 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:30.382362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6fca4-4f62-4ec0-a013-caa579f95887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:30.417432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6fe6fca4-4f62-4ec0-a013-caa579f95887 None None] MFA Rules not processed for user `e395d0436d2443f5a6e55e137d375549`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:30.417805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f05ef93b4984d009c26553254d98e92', 'request_id': 'req-a3e50725-6060-4877-b433-2f4d48d63a36'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.419345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6fe6fca4-4f62-4ec0-a013-caa579f95887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:30.510586 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 892/1767] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:30.512751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002651c5-e8b9-40f5-9ed5-b64d4a9c9a0b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:30.513253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002651c5-e8b9-40f5-9ed5-b64d4a9c9a0b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:30.513724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002651c5-e8b9-40f5-9ed5-b64d4a9c9a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:30.537718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-002651c5-e8b9-40f5-9ed5-b64d4a9c9a0b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:30.537915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] The token cache is being invalidate because project 1f05ef93b4984d009c26553254d98e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:30.538076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.539610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-002651c5-e8b9-40f5-9ed5-b64d4a9c9a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:30.539794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.544125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 876/1768] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:29 2022] DELETE /identity/v3/projects/1f05ef93b4984d009c26553254d98e92 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:30.545230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:30.549162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:30.620759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 893/1769] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:30.628384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002651c5-e8b9-40f5-9ed5-b64d4a9c9a0b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:30.630748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-002651c5-e8b9-40f5-9ed5-b64d4a9c9a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:30.644277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002651c5-e8b9-40f5-9ed5-b64d4a9c9a0b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:30.650534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec2041-9ae0-4190-9918-3ce89bd7fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:30.651607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec2041-9ae0-4190-9918-3ce89bd7fa72 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:30.652475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec2041-9ae0-4190-9918-3ce89bd7fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:30.652964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec2041-9ae0-4190-9918-3ce89bd7fa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:30.653882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec2041-9ae0-4190-9918-3ce89bd7fa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:30.665256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec2041-9ae0-4190-9918-3ce89bd7fa72 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:30.693829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 894/1770] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:30.699405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec2041-9ae0-4190-9918-3ce89bd7fa72 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:30.699405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f1ec2041-9ae0-4190-9918-3ce89bd7fa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:30.710982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec2041-9ae0-4190-9918-3ce89bd7fa72 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:30.715980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:30.716784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:30.717167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:30.717543 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] PATH_INFO: `/v3/users/3425b4c27b5b4179a46f57bec8ab7d6d` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:30.718838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3425b4c27b5b4179a46f57bec8ab7d6d)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:30.721075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:30.797981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e50725-6060-4877-b433-2f4d48d63a36 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:30.806085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2cb8b-4f03-4cae-ba83-eac4b3f99fb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:30.807493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2cb8b-4f03-4cae-ba83-eac4b3f99fb8 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:30.807493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2cb8b-4f03-4cae-ba83-eac4b3f99fb8 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:30.812464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2cb8b-4f03-4cae-ba83-eac4b3f99fb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:30.812464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7fd2cb8b-4f03-4cae-ba83-eac4b3f99fb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:30.899115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2cb8b-4f03-4cae-ba83-eac4b3f99fb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:30.900957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2cb8b-4f03-4cae-ba83-eac4b3f99fb8 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:30.918271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 877/1771] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 19:59:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 19:59:30.920155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab56a92-27d8-4c8e-9bde-01101356bd3d None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:30.920155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab56a92-27d8-4c8e-9bde-01101356bd3d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:30.920356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab56a92-27d8-4c8e-9bde-01101356bd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:30.961583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9ab56a92-27d8-4c8e-9bde-01101356bd3d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:30.964263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9ab56a92-27d8-4c8e-9bde-01101356bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:30.983923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 878/1772] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:30.986088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3425b4c27b5b4179a46f57bec8ab7d6d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.987360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3425b4c27b5b4179a46f57bec8ab7d6d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:30.988477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab56a92-27d8-4c8e-9bde-01101356bd3d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:31.016412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab56a92-27d8-4c8e-9bde-01101356bd3d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:31.026717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1076e3-b4b2-4216-b75d-999dd6b113a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:31.028089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1076e3-b4b2-4216-b75d-999dd6b113a8 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:31.036998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1076e3-b4b2-4216-b75d-999dd6b113a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:31.036998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1076e3-b4b2-4216-b75d-999dd6b113a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:31.036998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1076e3-b4b2-4216-b75d-999dd6b113a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:31.036998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1076e3-b4b2-4216-b75d-999dd6b113a8 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:31.057505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3425b4c27b5b4179a46f57bec8ab7d6d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:31.078097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3425b4c27b5b4179a46f57bec8ab7d6d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:31.086524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 879/1773] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:31.089154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1076e3-b4b2-4216-b75d-999dd6b113a8 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:31.095183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5d1076e3-b4b2-4216-b75d-999dd6b113a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:31.114883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3425b4c27b5b4179a46f57bec8ab7d6d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:31.159643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 895/1774] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:30 2022] DELETE /identity/v3/users/3425b4c27b5b4179a46f57bec8ab7d6d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:31.159643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:31.159982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1076e3-b4b2-4216-b75d-999dd6b113a8 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:31.160081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:31.296283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:31.361851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc626427-7cc0-4556-81f3-11d8bb990ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:31.362354 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae76477-a4a8-47f2-bc20-99010664a357 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:31.362486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc626427-7cc0-4556-81f3-11d8bb990ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:31.362714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc626427-7cc0-4556-81f3-11d8bb990ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:31.363191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc626427-7cc0-4556-81f3-11d8bb990ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:31.378118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1b288-f11c-4314-9c6b-e9986985956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:31.379887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc626427-7cc0-4556-81f3-11d8bb990ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:31.380758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc626427-7cc0-4556-81f3-11d8bb990ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:31.382005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b288-f11c-4314-9c6b-e9986985956b admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:31.385137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc626427-7cc0-4556-81f3-11d8bb990ec1 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:31.396231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b288-f11c-4314-9c6b-e9986985956b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:31.398920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b288-f11c-4314-9c6b-e9986985956b admin admin] PATH_INFO: `/v3/projects/dd2a746cec5d4c05b5e936bdcad2ff10/users/5b2e98cd066c42c38d75b4fdc1d50a0d/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:31.441589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 880/1775] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:31.443053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1b288-f11c-4314-9c6b-e9986985956b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2a746cec5d4c05b5e936bdcad2ff10, user_id=5b2e98cd066c42c38d75b4fdc1d50a0d, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:31.443267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc626427-7cc0-4556-81f3-11d8bb990ec1 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:31.446115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1b288-f11c-4314-9c6b-e9986985956b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:31.478333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc626427-7cc0-4556-81f3-11d8bb990ec1 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:31.504988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b427-9527-414a-b367-9c88494cb3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:31.505898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b427-9527-414a-b367-9c88494cb3ef admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:31.506188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b427-9527-414a-b367-9c88494cb3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:31.506462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b427-9527-414a-b367-9c88494cb3ef admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:31.507250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b427-9527-414a-b367-9c88494cb3ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:31.509409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b427-9527-414a-b367-9c88494cb3ef admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:31.551842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 896/1776] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:31 2022] PUT /identity/v3/projects/dd2a746cec5d4c05b5e936bdcad2ff10/users/5b2e98cd066c42c38d75b4fdc1d50a0d/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:31.566146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac94dd-fd34-4569-930c-0d8c22496b41 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:31.566720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac94dd-fd34-4569-930c-0d8c22496b41 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:31.567179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac94dd-fd34-4569-930c-0d8c22496b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:31.693688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 881/1777] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:31 2022] POST /identity/v3/projects => generated 363 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:31.694407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-54ac94dd-fd34-4569-930c-0d8c22496b41 None None] MFA Rules not processed for user `5b2e98cd066c42c38d75b4fdc1d50a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:31.699690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b427-9527-414a-b367-9c88494cb3ef admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:31.703832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-54ac94dd-fd34-4569-930c-0d8c22496b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:31.856673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b427-9527-414a-b367-9c88494cb3ef admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:31.870172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7f422-f355-4824-8403-6d0e673eb607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:31.871197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7f422-f355-4824-8403-6d0e673eb607 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:31.871822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7f422-f355-4824-8403-6d0e673eb607 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:31.872275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7f422-f355-4824-8403-6d0e673eb607 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:31.873620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7f422-f355-4824-8403-6d0e673eb607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:31.877624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7f422-f355-4824-8403-6d0e673eb607 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:31.911920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:31.966646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 897/1778] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:31.967737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac94dd-fd34-4569-930c-0d8c22496b41 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:31.985929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac94dd-fd34-4569-930c-0d8c22496b41 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:32.008192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c91f-a313-4352-9080-4609212c82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:32.008831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c91f-a313-4352-9080-4609212c82ec admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:32.009168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c91f-a313-4352-9080-4609212c82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:32.009433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c91f-a313-4352-9080-4609212c82ec admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:32.010122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42c91f-a313-4352-9080-4609212c82ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:32.012155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42c91f-a313-4352-9080-4609212c82ec admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:32.027993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 882/1779] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:31 2022] POST /identity/v3/users => generated 282 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:32.037945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7f422-f355-4824-8403-6d0e673eb607 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:32.054280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7f422-f355-4824-8403-6d0e673eb607 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:32.110410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b25104-89a4-43e1-8e26-fbfaf453bed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:32.112088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b25104-89a4-43e1-8e26-fbfaf453bed6 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:32.115827 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b25104-89a4-43e1-8e26-fbfaf453bed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:32.116266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b25104-89a4-43e1-8e26-fbfaf453bed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:32.117152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b25104-89a4-43e1-8e26-fbfaf453bed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:32.119784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b25104-89a4-43e1-8e26-fbfaf453bed6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:32.149099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 883/1780] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:32.150821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b25104-89a4-43e1-8e26-fbfaf453bed6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:32.166855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 898/1781] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:31 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:32.169278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-07b25104-89a4-43e1-8e26-fbfaf453bed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:32.170100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c91f-a313-4352-9080-4609212c82ec admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:32.334361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b25104-89a4-43e1-8e26-fbfaf453bed6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:32.563618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c91f-a313-4352-9080-4609212c82ec admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:32.563618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a6c1-4ff1-42df-99d4-73763a149ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:32.563618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a6c1-4ff1-42df-99d4-73763a149ecd admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:32.563618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a6c1-4ff1-42df-99d4-73763a149ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:32.566869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a6c1-4ff1-42df-99d4-73763a149ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:32.566869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a6c1-4ff1-42df-99d4-73763a149ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:32.566869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212a6c1-4ff1-42df-99d4-73763a149ecd admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:32.566869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 899/1782] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:32.566869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a6c1-4ff1-42df-99d4-73763a149ecd admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:32.568075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:32.568075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:32.568075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:32.568075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] PATH_INFO: `/v3/projects/9c426211241843649505b1629e24dae6` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:32.568902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c426211241843649505b1629e24dae6)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:32.569259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212a6c1-4ff1-42df-99d4-73763a149ecd admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:32.569655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:32.574134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af91fda-3cc4-4f74-9387-4a691d2155c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:32.574134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af91fda-3cc4-4f74-9387-4a691d2155c1 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:32.574134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af91fda-3cc4-4f74-9387-4a691d2155c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:32.574134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af91fda-3cc4-4f74-9387-4a691d2155c1 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:32.574976 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af91fda-3cc4-4f74-9387-4a691d2155c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:32.574976 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af91fda-3cc4-4f74-9387-4a691d2155c1 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:32.852836 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 900/1783] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:32 2022] POST /identity/v3/users => generated 290 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:32.856139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6fdca-b1dc-4864-bcbb-18208ac2317c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:32.856432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6fdca-b1dc-4864-bcbb-18208ac2317c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:32.858440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6fdca-b1dc-4864-bcbb-18208ac2317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:32.920942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c2d6fdca-b1dc-4864-bcbb-18208ac2317c None None] MFA Rules not processed for user `e6d3fd0d74c94f88aef2f0be0047ee9a`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:32.922362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c2d6fdca-b1dc-4864-bcbb-18208ac2317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:32.930144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c426211241843649505b1629e24dae6', 'request_id': 'req-c97de751-9544-4cf8-86d2-572a17ea1125'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:32.947960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c426211241843649505b1629e24dae6', 'request_id': 'req-c97de751-9544-4cf8-86d2-572a17ea1125'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:32.972070 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c426211241843649505b1629e24dae6', 'request_id': 'req-c97de751-9544-4cf8-86d2-572a17ea1125'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:33.106759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] The token cache is being invalidate because project 9c426211241843649505b1629e24dae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:33.106759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:33.112943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:33.132461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 884/1784] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:32 2022] DELETE /identity/v3/projects/9c426211241843649505b1629e24dae6 => generated 0 bytes in 978 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:33.134884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:33.142177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:33.159216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 901/1785] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:33.159216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6fdca-b1dc-4864-bcbb-18208ac2317c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:33.173598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c2d6fdca-b1dc-4864-bcbb-18208ac2317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:33.282988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97de751-9544-4cf8-86d2-572a17ea1125 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:33.302455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2381e95-b0d7-44dc-9fa5-4219414a982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:33.304029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2381e95-b0d7-44dc-9fa5-4219414a982e admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:33.304747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2381e95-b0d7-44dc-9fa5-4219414a982e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:33.305172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2381e95-b0d7-44dc-9fa5-4219414a982e admin admin] PATH_INFO: `/v3/projects/d77e575e32b8483f81a4b70eb6588e3a/users/5dee9b6e03254715a442d7bbb9252846/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:33.326167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2381e95-b0d7-44dc-9fa5-4219414a982e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77e575e32b8483f81a4b70eb6588e3a, user_id=5dee9b6e03254715a442d7bbb9252846, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:33.330359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2381e95-b0d7-44dc-9fa5-4219414a982e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:33.425048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6fdca-b1dc-4864-bcbb-18208ac2317c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:33.442958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52314278-939a-4166-89a9-a5ff091ae2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:33.447450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52314278-939a-4166-89a9-a5ff091ae2dd admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:33.447983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52314278-939a-4166-89a9-a5ff091ae2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:33.448405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52314278-939a-4166-89a9-a5ff091ae2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:33.449847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52314278-939a-4166-89a9-a5ff091ae2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:33.475763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 885/1786] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:33 2022] PUT /identity/v3/projects/d77e575e32b8483f81a4b70eb6588e3a/users/5dee9b6e03254715a442d7bbb9252846/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:33.478932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade198c-ced9-45c9-bbf9-29f5d0a002c6 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:33.479489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade198c-ced9-45c9-bbf9-29f5d0a002c6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:33.479906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade198c-ced9-45c9-bbf9-29f5d0a002c6 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:33.480702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52314278-939a-4166-89a9-a5ff091ae2dd admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:33.484715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 886/1787] 10.222.0.18 () {54 vars in 912 bytes} [Mon Aug 22 19:59:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:33.487949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13196c-0c1b-4c76-8992-14cea60f6d18 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:33.490503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13196c-0c1b-4c76-8992-14cea60f6d18 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:33.490998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13196c-0c1b-4c76-8992-14cea60f6d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:33.529401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 902/1788] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:33.530906 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6f9a7-1550-4690-8d76-7a8ea03c9c20 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:33.531196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6f9a7-1550-4690-8d76-7a8ea03c9c20 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:33.531503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6f9a7-1550-4690-8d76-7a8ea03c9c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:33.571375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-2d13196c-0c1b-4c76-8992-14cea60f6d18 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:33.575454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2d13196c-0c1b-4c76-8992-14cea60f6d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:33.687216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-cce6f9a7-1550-4690-8d76-7a8ea03c9c20 None None] MFA Rules not processed for user `5dee9b6e03254715a442d7bbb9252846`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:33.688587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cce6f9a7-1550-4690-8d76-7a8ea03c9c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:33.763300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 887/1789] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:33.771878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f9ae-8cc4-4cc2-bdeb-60098735ea1c None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:33.772395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f9ae-8cc4-4cc2-bdeb-60098735ea1c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:33.772816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774f9ae-8cc4-4cc2-bdeb-60098735ea1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:33.802833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9774f9ae-8cc4-4cc2-bdeb-60098735ea1c None None] MFA Rules not processed for user `7500529eff574ca6ae3a9a77d72d2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:33.806540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9774f9ae-8cc4-4cc2-bdeb-60098735ea1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:33.893363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 888/1790] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:33.895366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f9ae-8cc4-4cc2-bdeb-60098735ea1c None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:33.935282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774f9ae-8cc4-4cc2-bdeb-60098735ea1c None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:33.944398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185de958-3b23-4bee-8698-f01dbf5b7d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:33.945124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185de958-3b23-4bee-8698-f01dbf5b7d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:33.949968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185de958-3b23-4bee-8698-f01dbf5b7d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:33.955666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185de958-3b23-4bee-8698-f01dbf5b7d47 admin admin] PATH_INFO: `/v3/projects/e3a7d1da12264186ae63ea975baa010f/users/3d5d57e48abf4cc7a60e10186aba10f1/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:33.975611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:33.979764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185de958-3b23-4bee-8698-f01dbf5b7d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a7d1da12264186ae63ea975baa010f, user_id=3d5d57e48abf4cc7a60e10186aba10f1, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:33.990307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185de958-3b23-4bee-8698-f01dbf5b7d47 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:33.997019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 903/1791] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:33.998344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da6af5-7c44-4a86-b354-06f9666c185c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:33.998636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da6af5-7c44-4a86-b354-06f9666c185c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:34.001064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da6af5-7c44-4a86-b354-06f9666c185c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:34.051493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-07da6af5-7c44-4a86-b354-06f9666c185c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:34.051493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-07da6af5-7c44-4a86-b354-06f9666c185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:34.095287 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 904/1792] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:34.096702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da6af5-7c44-4a86-b354-06f9666c185c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:34.100909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-07da6af5-7c44-4a86-b354-06f9666c185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:34.112690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 889/1793] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:33 2022] PUT /identity/v3/projects/e3a7d1da12264186ae63ea975baa010f/users/3d5d57e48abf4cc7a60e10186aba10f1/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:34.118837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185de958-3b23-4bee-8698-f01dbf5b7d47 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:34.137417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da6af5-7c44-4a86-b354-06f9666c185c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:34.276782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e32915-7721-495d-aa69-345f680f3e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:34.277509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e32915-7721-495d-aa69-345f680f3e05 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:34.277834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e32915-7721-495d-aa69-345f680f3e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:34.278107 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e32915-7721-495d-aa69-345f680f3e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:34.290324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e32915-7721-495d-aa69-345f680f3e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:34.291877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e32915-7721-495d-aa69-345f680f3e05 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:34.311610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 905/1794] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:34.313994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e32915-7721-495d-aa69-345f680f3e05 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:34.392309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185de958-3b23-4bee-8698-f01dbf5b7d47 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:34.403557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abba3f2-371b-49e3-b81c-cd6d6eac9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:34.404504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abba3f2-371b-49e3-b81c-cd6d6eac9ccb admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:34.404504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abba3f2-371b-49e3-b81c-cd6d6eac9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:34.407051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abba3f2-371b-49e3-b81c-cd6d6eac9ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:34.407051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abba3f2-371b-49e3-b81c-cd6d6eac9ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:34.409835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abba3f2-371b-49e3-b81c-cd6d6eac9ccb admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:34.526542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e32915-7721-495d-aa69-345f680f3e05 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:34.548357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0584b-5338-45d0-b380-887cd6697ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:34.549026 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0584b-5338-45d0-b380-887cd6697ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:34.549259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0584b-5338-45d0-b380-887cd6697ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:34.549526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0584b-5338-45d0-b380-887cd6697ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:34.550232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0584b-5338-45d0-b380-887cd6697ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:34.550485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0584b-5338-45d0-b380-887cd6697ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:34.552692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0584b-5338-45d0-b380-887cd6697ec1 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:34.595292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 906/1795] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:34.595292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0584b-5338-45d0-b380-887cd6697ec1 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:34.615339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0584b-5338-45d0-b380-887cd6697ec1 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:34.621577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3da550-6721-42b9-89da-d862ff8a3f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:34.652106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3da550-6721-42b9-89da-d862ff8a3f35 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:34.652382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3da550-6721-42b9-89da-d862ff8a3f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:34.652653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3da550-6721-42b9-89da-d862ff8a3f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:34.653326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3da550-6721-42b9-89da-d862ff8a3f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:34.654980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 890/1796] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:34 2022] POST /identity/v3/projects => generated 365 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:34.658715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f268e05-a161-4c1d-ae5e-8de047f240ce None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:34.660281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f268e05-a161-4c1d-ae5e-8de047f240ce None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:34.660613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f268e05-a161-4c1d-ae5e-8de047f240ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:34.669733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3da550-6721-42b9-89da-d862ff8a3f35 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:34.729627 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 907/1797] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:34.733737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3da550-6721-42b9-89da-d862ff8a3f35 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:34.735872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-2f268e05-a161-4c1d-ae5e-8de047f240ce None None] MFA Rules not processed for user `7500529eff574ca6ae3a9a77d72d2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:34.738054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2f268e05-a161-4c1d-ae5e-8de047f240ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:34.755709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3da550-6721-42b9-89da-d862ff8a3f35 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:34.841821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:34.955731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77e138-b094-4c1e-a244-29eaa4607cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:34.960531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77e138-b094-4c1e-a244-29eaa4607cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:34.961808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77e138-b094-4c1e-a244-29eaa4607cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:34.963097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77e138-b094-4c1e-a244-29eaa4607cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:34.966661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77e138-b094-4c1e-a244-29eaa4607cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:34.972598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 891/1798] 10.222.0.59 () {58 vars in 1015 bytes} [Mon Aug 22 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:34.973505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f268e05-a161-4c1d-ae5e-8de047f240ce None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:34.977891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77e138-b094-4c1e-a244-29eaa4607cd5 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:34.987557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f268e05-a161-4c1d-ae5e-8de047f240ce None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:34.993096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5d1d-4f21-4e46-ad3b-c904f19e6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:34.994146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5d1d-4f21-4e46-ad3b-c904f19e6e9b admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:34.994262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5d1d-4f21-4e46-ad3b-c904f19e6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:34.994543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a5d1d-4f21-4e46-ad3b-c904f19e6e9b admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:34.995188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a5d1d-4f21-4e46-ad3b-c904f19e6e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:34.997431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a5d1d-4f21-4e46-ad3b-c904f19e6e9b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:35.119644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 892/1799] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:34 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:35.121342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5d1d-4f21-4e46-ad3b-c904f19e6e9b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:35.148549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a5d1d-4f21-4e46-ad3b-c904f19e6e9b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:35.149463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 908/1800] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:34 2022] POST /identity/v3/projects => generated 357 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:35.154380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77e138-b094-4c1e-a244-29eaa4607cd5 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:35.156908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ee77e138-b094-4c1e-a244-29eaa4607cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:35.378682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77e138-b094-4c1e-a244-29eaa4607cd5 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:35.387506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97155c87-ae6a-4003-8fbc-3d6de234463c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:35.389140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97155c87-ae6a-4003-8fbc-3d6de234463c service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:35.389615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97155c87-ae6a-4003-8fbc-3d6de234463c service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:35.390271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97155c87-ae6a-4003-8fbc-3d6de234463c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:35.428381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97155c87-ae6a-4003-8fbc-3d6de234463c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:35.430369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97155c87-ae6a-4003-8fbc-3d6de234463c service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:35.451127 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a98498-e7db-4e0f-bfd5-bf27dc6001b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:35.452465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a98498-e7db-4e0f-bfd5-bf27dc6001b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:35.452465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a98498-e7db-4e0f-bfd5-bf27dc6001b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:35.452465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a98498-e7db-4e0f-bfd5-bf27dc6001b1 admin admin] PATH_INFO: `/v3/projects/e3a7d1da12264186ae63ea975baa010f/users/3d5d57e48abf4cc7a60e10186aba10f1/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:35.458004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 909/1801] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:35.461567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97155c87-ae6a-4003-8fbc-3d6de234463c service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:35.487041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a98498-e7db-4e0f-bfd5-bf27dc6001b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a7d1da12264186ae63ea975baa010f, user_id=3d5d57e48abf4cc7a60e10186aba10f1, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:35.495539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97155c87-ae6a-4003-8fbc-3d6de234463c service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:35.507043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714b84b-3138-4ceb-aff2-2cd2c991d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:35.507043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714b84b-3138-4ceb-aff2-2cd2c991d8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:35.507320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714b84b-3138-4ceb-aff2-2cd2c991d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:35.510945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a98498-e7db-4e0f-bfd5-bf27dc6001b1 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:35.515671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714b84b-3138-4ceb-aff2-2cd2c991d8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:35.516607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714b84b-3138-4ceb-aff2-2cd2c991d8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:35.518873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714b84b-3138-4ceb-aff2-2cd2c991d8f2 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:35.542387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 910/1802] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:35.543398 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714b84b-3138-4ceb-aff2-2cd2c991d8f2 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:35.547254 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 893/1803] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:35 2022] PUT /identity/v3/projects/e3a7d1da12264186ae63ea975baa010f/users/3d5d57e48abf4cc7a60e10186aba10f1/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:35.548424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a98498-e7db-4e0f-bfd5-bf27dc6001b1 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:35.579970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714b84b-3138-4ceb-aff2-2cd2c991d8f2 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:35.731703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a98498-e7db-4e0f-bfd5-bf27dc6001b1 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:35.738946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5deb3-3b10-4507-b5b3-102a48271b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:35.740036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5deb3-3b10-4507-b5b3-102a48271b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:35.740759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5deb3-3b10-4507-b5b3-102a48271b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:35.741173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5deb3-3b10-4507-b5b3-102a48271b6a admin admin] PATH_INFO: `/v3/projects/c5cff7cb02254a5dbc946a8a70727840/users/55e5eb4762344f268e6c9972323502cd/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:35.761283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5deb3-3b10-4507-b5b3-102a48271b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cff7cb02254a5dbc946a8a70727840, user_id=55e5eb4762344f268e6c9972323502cd, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:35.766104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5deb3-3b10-4507-b5b3-102a48271b6a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:35.780690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9a4e4-8b53-4c66-9402-55c571f2ea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:35.781322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9a4e4-8b53-4c66-9402-55c571f2ea50 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:35.781601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9a4e4-8b53-4c66-9402-55c571f2ea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:35.781873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9a4e4-8b53-4c66-9402-55c571f2ea50 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:35.783032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9a4e4-8b53-4c66-9402-55c571f2ea50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:35.799721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9a4e4-8b53-4c66-9402-55c571f2ea50 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:35.879202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 894/1804] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:35 2022] PUT /identity/v3/projects/c5cff7cb02254a5dbc946a8a70727840/users/55e5eb4762344f268e6c9972323502cd/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:35.884873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980201-8ce6-45c7-b5b8-d9594f8cfeec None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:35.885231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980201-8ce6-45c7-b5b8-d9594f8cfeec None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:35.885597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e980201-8ce6-45c7-b5b8-d9594f8cfeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:35.954708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 911/1805] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:35 2022] POST /identity/v3/users => generated 279 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:35.954708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9a4e4-8b53-4c66-9402-55c571f2ea50 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:35.978841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-9e980201-8ce6-45c7-b5b8-d9594f8cfeec None None] MFA Rules not processed for user `3d5d57e48abf4cc7a60e10186aba10f1`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:35.985935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9e980201-8ce6-45c7-b5b8-d9594f8cfeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:35.989141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9a4e4-8b53-4c66-9402-55c571f2ea50 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:36.176964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 895/1806] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:36.178845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e980201-8ce6-45c7-b5b8-d9594f8cfeec None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:36.217959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13a410-abc1-4b46-92e1-a0712577d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:36.218837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13a410-abc1-4b46-92e1-a0712577d3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:36.219621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13a410-abc1-4b46-92e1-a0712577d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:36.221666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13a410-abc1-4b46-92e1-a0712577d3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:36.221666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13a410-abc1-4b46-92e1-a0712577d3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:36.226704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13a410-abc1-4b46-92e1-a0712577d3a5 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:36.256760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 912/1807] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:36.265210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13a410-abc1-4b46-92e1-a0712577d3a5 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:36.265210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fe13a410-abc1-4b46-92e1-a0712577d3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:36.265577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:36.381355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13a410-abc1-4b46-92e1-a0712577d3a5 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:36.384231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c263f-9f30-48f9-8d60-814dd990e868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:36.385595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c263f-9f30-48f9-8d60-814dd990e868 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:36.388163 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c263f-9f30-48f9-8d60-814dd990e868 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:36.389603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c263f-9f30-48f9-8d60-814dd990e868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:36.414788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e980201-8ce6-45c7-b5b8-d9594f8cfeec None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:36.436259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c263f-9f30-48f9-8d60-814dd990e868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:36.437513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986e86d-ab3f-4f88-9947-7f7028a781f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:36.437841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021c263f-9f30-48f9-8d60-814dd990e868 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:36.439143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986e86d-ab3f-4f88-9947-7f7028a781f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:36.439541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986e86d-ab3f-4f88-9947-7f7028a781f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:36.439817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986e86d-ab3f-4f88-9947-7f7028a781f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:36.443064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986e86d-ab3f-4f88-9947-7f7028a781f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:36.445093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986e86d-ab3f-4f88-9947-7f7028a781f1 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:36.466104 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 913/1808] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:36.482678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c263f-9f30-48f9-8d60-814dd990e868 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:36.489213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 896/1809] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:36.493849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986e86d-ab3f-4f88-9947-7f7028a781f1 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:36.512555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986e86d-ab3f-4f88-9947-7f7028a781f1 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:36.534967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4d552-e430-4948-9125-5c16ef1c5a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:36.535691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4d552-e430-4948-9125-5c16ef1c5a19 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:36.541095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4d552-e430-4948-9125-5c16ef1c5a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:36.541095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4d552-e430-4948-9125-5c16ef1c5a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:36.541095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4d552-e430-4948-9125-5c16ef1c5a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:36.541095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4d552-e430-4948-9125-5c16ef1c5a19 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:36.562978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c263f-9f30-48f9-8d60-814dd990e868 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:36.579099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4b989-3eac-4eab-b296-8a03cad92586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:36.580198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4b989-3eac-4eab-b296-8a03cad92586 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:36.580478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4b989-3eac-4eab-b296-8a03cad92586 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:36.580757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4b989-3eac-4eab-b296-8a03cad92586 admin admin] PATH_INFO: `/v3/projects/c5cff7cb02254a5dbc946a8a70727840/users/55e5eb4762344f268e6c9972323502cd/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:36.581056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 897/1810] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:36.590123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4b989-3eac-4eab-b296-8a03cad92586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5cff7cb02254a5dbc946a8a70727840, user_id=55e5eb4762344f268e6c9972323502cd, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:36.591446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4d552-e430-4948-9125-5c16ef1c5a19 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:36.595202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4b989-3eac-4eab-b296-8a03cad92586 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:36.624333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 914/1811] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:36 2022] PUT /identity/v3/projects/c5cff7cb02254a5dbc946a8a70727840/users/55e5eb4762344f268e6c9972323502cd/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:36.634500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772b76c-d6d2-4145-ac27-86c42e1e1401 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:36.634790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772b76c-d6d2-4145-ac27-86c42e1e1401 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:36.635256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772b76c-d6d2-4145-ac27-86c42e1e1401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:36.652252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4d552-e430-4948-9125-5c16ef1c5a19 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:36.781775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b772b76c-d6d2-4145-ac27-86c42e1e1401 None None] MFA Rules not processed for user `55e5eb4762344f268e6c9972323502cd`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:36.783638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b772b76c-d6d2-4145-ac27-86c42e1e1401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:36.890531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:36.975734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b341de9-5536-4442-856b-382d67d7de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:36.976731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341de9-5536-4442-856b-382d67d7de8c admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:36.976731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341de9-5536-4442-856b-382d67d7de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:36.976950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b341de9-5536-4442-856b-382d67d7de8c admin admin] PATH_INFO: `/v3/projects/9b9fdd6e83e64fceb9183ad28b536aae/users/582c18bfa529474bab35b13eabab3bdc/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:36.981885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:37.060396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b341de9-5536-4442-856b-382d67d7de8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9fdd6e83e64fceb9183ad28b536aae, user_id=582c18bfa529474bab35b13eabab3bdc, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:37.063736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b341de9-5536-4442-856b-382d67d7de8c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:37.155495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 915/1812] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:37.155495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772b76c-d6d2-4145-ac27-86c42e1e1401 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:37.211337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 898/1813] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:36 2022] PUT /identity/v3/projects/9b9fdd6e83e64fceb9183ad28b536aae/users/582c18bfa529474bab35b13eabab3bdc/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:37.218031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11767301-4258-48f5-86ac-d7d82d86f163 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:37.218567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11767301-4258-48f5-86ac-d7d82d86f163 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:37.219093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11767301-4258-48f5-86ac-d7d82d86f163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:37.418085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-11767301-4258-48f5-86ac-d7d82d86f163 None None] MFA Rules not processed for user `582c18bfa529474bab35b13eabab3bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:37.421751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-11767301-4258-48f5-86ac-d7d82d86f163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:37.424125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772b76c-d6d2-4145-ac27-86c42e1e1401 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:37.579178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 899/1814] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:37.580398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11767301-4258-48f5-86ac-d7d82d86f163 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:37.646368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:37.647303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:37.647783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:37.649266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:37.655694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:37.679109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11767301-4258-48f5-86ac-d7d82d86f163 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:37.686385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6260db5-4d5f-4986-ac7b-f20366b9417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:37.687564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6260db5-4d5f-4986-ac7b-f20366b9417d admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:37.687782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6260db5-4d5f-4986-ac7b-f20366b9417d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:37.688119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6260db5-4d5f-4986-ac7b-f20366b9417d admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:37.688841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6260db5-4d5f-4986-ac7b-f20366b9417d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:37.691022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6260db5-4d5f-4986-ac7b-f20366b9417d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:37.784474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:37.788110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:37.801939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 916/1815] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:37.803024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:37.804747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:37.817931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741aab4-41c7-4996-a612-14a1c03333b3 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:37.823413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703b132-d319-4f9c-a8cf-547e1537b84c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:37.825975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b132-d319-4f9c-a8cf-547e1537b84c service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:37.826982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b132-d319-4f9c-a8cf-547e1537b84c service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:37.827579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703b132-d319-4f9c-a8cf-547e1537b84c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:37.939301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 900/1816] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:37 2022] POST /identity/v3/projects => generated 357 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:37.943358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6260db5-4d5f-4986-ac7b-f20366b9417d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:38.088261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703b132-d319-4f9c-a8cf-547e1537b84c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:38.094121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703b132-d319-4f9c-a8cf-547e1537b84c service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:38.147711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 917/1817] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:38.154244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cd981-c049-46c2-a65b-8e41c9142929 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:38.154546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cd981-c049-46c2-a65b-8e41c9142929 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:38.154822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cd981-c049-46c2-a65b-8e41c9142929 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:38.163372 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 918/1818] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 19:59:38 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:38.195514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6260db5-4d5f-4986-ac7b-f20366b9417d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:38.304963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce9f54-5e04-4e46-8174-49606680a047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:38.304963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce9f54-5e04-4e46-8174-49606680a047 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:38.304963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce9f54-5e04-4e46-8174-49606680a047 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:38.304963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce9f54-5e04-4e46-8174-49606680a047 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:38.305874 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce9f54-5e04-4e46-8174-49606680a047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:38.305874 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce9f54-5e04-4e46-8174-49606680a047 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:38.306037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b863da-04d9-48bd-82c9-eaeab68bfdf2 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:38.306037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b863da-04d9-48bd-82c9-eaeab68bfdf2 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:38.306037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b863da-04d9-48bd-82c9-eaeab68bfdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:38.321584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-30b863da-04d9-48bd-82c9-eaeab68bfdf2 None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:38.323766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-30b863da-04d9-48bd-82c9-eaeab68bfdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:38.513583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 919/1819] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 19:59:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:38.524979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b863da-04d9-48bd-82c9-eaeab68bfdf2 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:38.549265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-30b863da-04d9-48bd-82c9-eaeab68bfdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:38.580751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b863da-04d9-48bd-82c9-eaeab68bfdf2 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:38.595900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294924-3c3c-45a1-b648-017489c908dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:38.597701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294924-3c3c-45a1-b648-017489c908dc service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:38.598525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294924-3c3c-45a1-b648-017489c908dc service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:38.600858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44294924-3c3c-45a1-b648-017489c908dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:38.621187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44294924-3c3c-45a1-b648-017489c908dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:38.625308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44294924-3c3c-45a1-b648-017489c908dc service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:38.643954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 920/1820] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:38.879303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 901/1821] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:37 2022] POST /identity/v3/users => generated 285 bytes in 936 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:38.884671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294924-3c3c-45a1-b648-017489c908dc service nova] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:38.905154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44294924-3c3c-45a1-b648-017489c908dc service nova] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:38.906550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:38.911515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113ba0d-9864-4ea9-9f0c-737c062aff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:38.916654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113ba0d-9864-4ea9-9f0c-737c062aff2e admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:38.916654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113ba0d-9864-4ea9-9f0c-737c062aff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:38.916654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113ba0d-9864-4ea9-9f0c-737c062aff2e admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:38.916654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113ba0d-9864-4ea9-9f0c-737c062aff2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:38.918602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113ba0d-9864-4ea9-9f0c-737c062aff2e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:38.945600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 921/1822] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:38.949956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce9f54-5e04-4e46-8174-49606680a047 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:38.988689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce9f54-5e04-4e46-8174-49606680a047 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:39.011833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5612-e98d-43f2-b927-52aefa9cbfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:39.023538 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5612-e98d-43f2-b927-52aefa9cbfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:39.024190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5612-e98d-43f2-b927-52aefa9cbfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:39.026159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5612-e98d-43f2-b927-52aefa9cbfc5 admin admin] PATH_INFO: `/v3/projects/65042ac75112403caa6639d158222a6e/users/c4d3449e34e14cd6ae5e18c1feb56ad0/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:39.094689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec5612-e98d-43f2-b927-52aefa9cbfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65042ac75112403caa6639d158222a6e, user_id=c4d3449e34e14cd6ae5e18c1feb56ad0, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:39.108874 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec5612-e98d-43f2-b927-52aefa9cbfc5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:39.235360 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 902/1823] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:38 2022] PUT /identity/v3/projects/65042ac75112403caa6639d158222a6e/users/c4d3449e34e14cd6ae5e18c1feb56ad0/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:39.247446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113ba0d-9864-4ea9-9f0c-737c062aff2e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:39.287794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113ba0d-9864-4ea9-9f0c-737c062aff2e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:39.554400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791570eb-2392-4667-8288-967cc1a0689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:39.554400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791570eb-2392-4667-8288-967cc1a0689c admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:39.555193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791570eb-2392-4667-8288-967cc1a0689c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:39.555193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791570eb-2392-4667-8288-967cc1a0689c admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:39.560111 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791570eb-2392-4667-8288-967cc1a0689c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:39.562784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791570eb-2392-4667-8288-967cc1a0689c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:39.583796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 922/1824] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:39.597770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5612-e98d-43f2-b927-52aefa9cbfc5 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:39.607695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5612-e98d-43f2-b927-52aefa9cbfc5 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:39.613835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd8632-bb57-4af3-945e-22c0c461ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:39.615754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8632-bb57-4af3-945e-22c0c461ae7f admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:39.616215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8632-bb57-4af3-945e-22c0c461ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:39.616661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8632-bb57-4af3-945e-22c0c461ae7f admin admin] PATH_INFO: `/v3/projects/65042ac75112403caa6639d158222a6e/users/c4d3449e34e14cd6ae5e18c1feb56ad0/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:39.620275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd8632-bb57-4af3-945e-22c0c461ae7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65042ac75112403caa6639d158222a6e, user_id=c4d3449e34e14cd6ae5e18c1feb56ad0, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:39.624939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd8632-bb57-4af3-945e-22c0c461ae7f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:39.641502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 903/1825] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:39 2022] PUT /identity/v3/projects/65042ac75112403caa6639d158222a6e/users/c4d3449e34e14cd6ae5e18c1feb56ad0/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:39.653503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851578b-5eae-4962-a7a4-c5cf63534fe1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:39.654211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851578b-5eae-4962-a7a4-c5cf63534fe1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:39.654799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851578b-5eae-4962-a7a4-c5cf63534fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:39.670575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd8632-bb57-4af3-945e-22c0c461ae7f admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:39.744275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b851578b-5eae-4962-a7a4-c5cf63534fe1 None None] MFA Rules not processed for user `c4d3449e34e14cd6ae5e18c1feb56ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:39.746053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b851578b-5eae-4962-a7a4-c5cf63534fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:39.792649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:39.921801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd8632-bb57-4af3-945e-22c0c461ae7f admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:39.928165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab796d9f-14c6-4642-9911-f9cce7a36bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:39.928911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab796d9f-14c6-4642-9911-f9cce7a36bdb service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:39.929268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab796d9f-14c6-4642-9911-f9cce7a36bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:39.929678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab796d9f-14c6-4642-9911-f9cce7a36bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:39.970400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 923/1826] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:39.989127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851578b-5eae-4962-a7a4-c5cf63534fe1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:40.002402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851578b-5eae-4962-a7a4-c5cf63534fe1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:40.024653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cc733-814f-4d54-897f-328792604b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:40.024900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cc733-814f-4d54-897f-328792604b4f service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:40.025140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cc733-814f-4d54-897f-328792604b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:40.025412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cc733-814f-4d54-897f-328792604b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:40.043065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab796d9f-14c6-4642-9911-f9cce7a36bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:40.045738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab796d9f-14c6-4642-9911-f9cce7a36bdb service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:40.048110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cc733-814f-4d54-897f-328792604b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:40.051653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cc733-814f-4d54-897f-328792604b4f service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:40.070642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 904/1827] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:40.076051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 924/1828] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:40.711665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab796d9f-14c6-4642-9911-f9cce7a36bdb service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:40.721388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab796d9f-14c6-4642-9911-f9cce7a36bdb service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:40.725665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31474b-26b7-49d2-a7eb-f194f8e9f8af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:40.726527 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31474b-26b7-49d2-a7eb-f194f8e9f8af service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:40.726995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31474b-26b7-49d2-a7eb-f194f8e9f8af service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:40.727506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31474b-26b7-49d2-a7eb-f194f8e9f8af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:40.803100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31474b-26b7-49d2-a7eb-f194f8e9f8af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:40.804971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31474b-26b7-49d2-a7eb-f194f8e9f8af service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:40.818393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 905/1829] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:41.535548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:41.891780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:42.077207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b4396-85b3-4869-8377-4a9edfd7a935 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:42.077498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b4396-85b3-4869-8377-4a9edfd7a935 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:42.077773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b4396-85b3-4869-8377-4a9edfd7a935 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:42.079334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 925/1830] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 19:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:42.112146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3688247-c458-43ab-adc7-bfd047c40856 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:42.112653 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3688247-c458-43ab-adc7-bfd047c40856 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:42.112741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3688247-c458-43ab-adc7-bfd047c40856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:42.132954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-c3688247-c458-43ab-adc7-bfd047c40856 None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:42.134197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c3688247-c458-43ab-adc7-bfd047c40856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:42.205622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 906/1831] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 19:59:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:42.218047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b4396-85b3-4869-8377-4a9edfd7a935 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:42.219775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b43b4396-85b3-4869-8377-4a9edfd7a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:42.238954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b4396-85b3-4869-8377-4a9edfd7a935 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:42.245825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2d23d-4ffa-4afb-8e3b-841d0188b0a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:42.246459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d23d-4ffa-4afb-8e3b-841d0188b0a0 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:42.246735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d23d-4ffa-4afb-8e3b-841d0188b0a0 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:42.247009 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2d23d-4ffa-4afb-8e3b-841d0188b0a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:42.259832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2d23d-4ffa-4afb-8e3b-841d0188b0a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:42.261854 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d2d23d-4ffa-4afb-8e3b-841d0188b0a0 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:42.282015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 926/1832] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:42.606894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:43.464730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3688247-c458-43ab-adc7-bfd047c40856 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:43.468647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c3688247-c458-43ab-adc7-bfd047c40856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:43.535358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:43.607298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3688247-c458-43ab-adc7-bfd047c40856 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:43.615052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:43.616146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:43.616896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:43.617325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] PATH_INFO: `/v3/users/1d9f345690444259967f7822e5433410` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:43.619858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9f345690444259967f7822e5433410)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:43.622756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:43.898091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9f345690444259967f7822e5433410'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:43.898789 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9f345690444259967f7822e5433410'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:43.906502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9f345690444259967f7822e5433410'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:44.040188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9f345690444259967f7822e5433410'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:44.054227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9f345690444259967f7822e5433410'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:44.064029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 907/1833] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:43 2022] DELETE /identity/v3/users/1d9f345690444259967f7822e5433410 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:44.070048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7491f-4315-4a09-a912-9e807e71c09b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:44.075946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7491f-4315-4a09-a912-9e807e71c09b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:44.075946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7491f-4315-4a09-a912-9e807e71c09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:44.091667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b6c7491f-4315-4a09-a912-9e807e71c09b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:44.092911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b6c7491f-4315-4a09-a912-9e807e71c09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:44.154931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 927/1834] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:44.166472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:44.169740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:44.332423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:44.343978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23322d1-566a-42fc-837f-0b098e4cd406 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:44.349885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aff8d-94d8-4066-8f36-592557f8f2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:44.350143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aff8d-94d8-4066-8f36-592557f8f2fd service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:44.350426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aff8d-94d8-4066-8f36-592557f8f2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:44.350698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aff8d-94d8-4066-8f36-592557f8f2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:44.361057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aff8d-94d8-4066-8f36-592557f8f2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:44.362751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aff8d-94d8-4066-8f36-592557f8f2fd service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:44.376730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 908/1835] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:44.549371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:44.785293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7491f-4315-4a09-a912-9e807e71c09b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:44.787333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b6c7491f-4315-4a09-a912-9e807e71c09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:44.799778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7491f-4315-4a09-a912-9e807e71c09b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:44.805746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:44.806393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:44.806677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:44.806955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] PATH_INFO: `/v3/users/5dee9b6e03254715a442d7bbb9252846` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:44.808167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dee9b6e03254715a442d7bbb9252846)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:44.810249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:44.970952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aff8d-94d8-4066-8f36-592557f8f2fd service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:44.972641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f80aff8d-94d8-4066-8f36-592557f8f2fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:44.993005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aff8d-94d8-4066-8f36-592557f8f2fd service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:45.003560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:45.003560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:45.003560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:45.003560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] PATH_INFO: `/v3/projects/c949434e62e04a22a938842f0eb74c16` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:45.004107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c949434e62e04a22a938842f0eb74c16)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:45.004107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:45.097918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dee9b6e03254715a442d7bbb9252846'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.098599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dee9b6e03254715a442d7bbb9252846'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.136015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c949434e62e04a22a938842f0eb74c16', 'request_id': 'req-bcc21a11-8717-4c90-b68b-126043f74f3a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.141663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c949434e62e04a22a938842f0eb74c16', 'request_id': 'req-bcc21a11-8717-4c90-b68b-126043f74f3a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.148610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c949434e62e04a22a938842f0eb74c16', 'request_id': 'req-bcc21a11-8717-4c90-b68b-126043f74f3a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.206773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dee9b6e03254715a442d7bbb9252846'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.214850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dee9b6e03254715a442d7bbb9252846'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.229285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1afa38ac-0fd2-451b-ab96-a129eaae8b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dee9b6e03254715a442d7bbb9252846'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.236056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:45.237519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 928/1836] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:44 2022] DELETE /identity/v3/users/5dee9b6e03254715a442d7bbb9252846 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:45.242380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7c511-ee40-41a9-831d-336ce481396d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:45.242659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7c511-ee40-41a9-831d-336ce481396d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:45.242930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7c511-ee40-41a9-831d-336ce481396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:45.267611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-acc7c511-ee40-41a9-831d-336ce481396d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:45.268856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-acc7c511-ee40-41a9-831d-336ce481396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:45.299598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] The token cache is being invalidate because project c949434e62e04a22a938842f0eb74c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:45.299980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.300811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.303055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 909/1837] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:44 2022] DELETE /identity/v3/projects/c949434e62e04a22a938842f0eb74c16 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:45.307086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:45.308556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:45.335276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 929/1838] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:45.345324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7c511-ee40-41a9-831d-336ce481396d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:45.346687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-acc7c511-ee40-41a9-831d-336ce481396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:45.392898 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc21a11-8717-4c90-b68b-126043f74f3a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:45.401144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:45.401519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:45.401824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:45.402100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] PATH_INFO: `/v3/users/59300690254b4ae19e04e8be8e888c9d` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:45.403298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59300690254b4ae19e04e8be8e888c9d)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:45.405295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:45.420110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7c511-ee40-41a9-831d-336ce481396d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:45.424763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f23a-9837-4038-9648-c98f9e978441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:45.429191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f23a-9837-4038-9648-c98f9e978441 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:45.429191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f23a-9837-4038-9648-c98f9e978441 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:45.429191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f23a-9837-4038-9648-c98f9e978441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:45.436296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4f23a-9837-4038-9648-c98f9e978441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:45.437761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4f23a-9837-4038-9648-c98f9e978441 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:45.449197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 930/1839] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:45.653319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:45.670502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59300690254b4ae19e04e8be8e888c9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.671188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59300690254b4ae19e04e8be8e888c9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.683530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59300690254b4ae19e04e8be8e888c9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.896038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59300690254b4ae19e04e8be8e888c9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.907912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59300690254b4ae19e04e8be8e888c9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:45.914759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 910/1840] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:45 2022] DELETE /identity/v3/users/59300690254b4ae19e04e8be8e888c9d => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:46.603746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:46.875189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:46.999857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f23a-9837-4038-9648-c98f9e978441 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:47.003260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-95a4f23a-9837-4038-9648-c98f9e978441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:47.023820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f23a-9837-4038-9648-c98f9e978441 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:47.053127 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:47.054842 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:47.179540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:47.180452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:47.180909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:47.182004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] PATH_INFO: `/v3/users/5b2e98cd066c42c38d75b4fdc1d50a0d` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:47.185295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb15ea2-8c5d-46de-b40a-af1b68102e99 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:47.185675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2e98cd066c42c38d75b4fdc1d50a0d)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:47.188215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:47.190691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:47.191615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:47.191744 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:47.193546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] PATH_INFO: `/v3/projects/d77e575e32b8483f81a4b70eb6588e3a` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:47.193866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77e575e32b8483f81a4b70eb6588e3a)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:47.197440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:47.423342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2e98cd066c42c38d75b4fdc1d50a0d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.425949 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2e98cd066c42c38d75b4fdc1d50a0d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.428819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77e575e32b8483f81a4b70eb6588e3a', 'request_id': 'req-4f178ccc-c114-438f-86a3-823e294f77bb'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.441493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77e575e32b8483f81a4b70eb6588e3a', 'request_id': 'req-4f178ccc-c114-438f-86a3-823e294f77bb'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.449340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77e575e32b8483f81a4b70eb6588e3a', 'request_id': 'req-4f178ccc-c114-438f-86a3-823e294f77bb'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.565868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2e98cd066c42c38d75b4fdc1d50a0d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.573703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2e98cd066c42c38d75b4fdc1d50a0d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.592419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2e98cd066c42c38d75b4fdc1d50a0d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.601474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 931/1841] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:46 2022] DELETE /identity/v3/users/5b2e98cd066c42c38d75b4fdc1d50a0d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:47.602389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:47.604189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:47.671214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] The token cache is being invalidate because project d77e575e32b8483f81a4b70eb6588e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:47.671648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.672464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4f178ccc-c114-438f-86a3-823e294f77bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.674605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 911/1842] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:47 2022] DELETE /identity/v3/projects/d77e575e32b8483f81a4b70eb6588e3a => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:47.675673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed622eda-8a55-48a3-b3d0-8d1efc020882 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:47.675960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed622eda-8a55-48a3-b3d0-8d1efc020882 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:47.676230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed622eda-8a55-48a3-b3d0-8d1efc020882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:47.690792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4be432-eb6d-4e71-8cef-aeece56aa2de admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:47.696775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:47.706762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:47.706762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:47.706762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] PATH_INFO: `/v3/projects/cda4a5383ed6419eb31baaa8b625a34b` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:47.706762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda4a5383ed6419eb31baaa8b625a34b)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:47.706762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:47.714675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ed622eda-8a55-48a3-b3d0-8d1efc020882 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:47.716280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ed622eda-8a55-48a3-b3d0-8d1efc020882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:47.726309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 912/1843] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:47.730456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed622eda-8a55-48a3-b3d0-8d1efc020882 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:47.731768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ed622eda-8a55-48a3-b3d0-8d1efc020882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:47.745502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed622eda-8a55-48a3-b3d0-8d1efc020882 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:47.750378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:47.751037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:47.751343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:47.751623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] PATH_INFO: `/v3/users/55e5eb4762344f268e6c9972323502cd` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:47.752848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e5eb4762344f268e6c9972323502cd)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:47.754816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:47.886663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda4a5383ed6419eb31baaa8b625a34b', 'request_id': 'req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.892886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda4a5383ed6419eb31baaa8b625a34b', 'request_id': 'req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.977243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda4a5383ed6419eb31baaa8b625a34b', 'request_id': 'req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.992002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] The token cache is being invalidate because project cda4a5383ed6419eb31baaa8b625a34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:47.992418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.993235 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:47.994934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 932/1844] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:47 2022] DELETE /identity/v3/projects/cda4a5383ed6419eb31baaa8b625a34b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:47.995759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:47.997122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:48.029165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e5eb4762344f268e6c9972323502cd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:48.030190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e5eb4762344f268e6c9972323502cd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:48.042140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e5eb4762344f268e6c9972323502cd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:48.061261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aaf9ba-93eb-44b1-af09-66e4c18b3f0a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:48.065169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15ba7b-5264-4693-9ffa-8911b6dac4b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:48.066245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15ba7b-5264-4693-9ffa-8911b6dac4b9 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.066745 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15ba7b-5264-4693-9ffa-8911b6dac4b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.067290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15ba7b-5264-4693-9ffa-8911b6dac4b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.070830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-da15ba7b-5264-4693-9ffa-8911b6dac4b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:48.125777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e5eb4762344f268e6c9972323502cd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:48.136376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15ba7b-5264-4693-9ffa-8911b6dac4b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:48.137901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15ba7b-5264-4693-9ffa-8911b6dac4b9 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:48.140059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6571629c-d2e3-4a8e-a932-5f1002f160be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e5eb4762344f268e6c9972323502cd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:48.146137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 913/1845] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:47 2022] DELETE /identity/v3/users/55e5eb4762344f268e6c9972323502cd => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:48.147605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e95a3-f6c4-4d80-a0c1-56210aaa5bf0 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.147890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e95a3-f6c4-4d80-a0c1-56210aaa5bf0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.148018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 933/1846] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:48.148159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e95a3-f6c4-4d80-a0c1-56210aaa5bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.169215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ef5e95a3-f6c4-4d80-a0c1-56210aaa5bf0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:48.170633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ef5e95a3-f6c4-4d80-a0c1-56210aaa5bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:48.233308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:48.251377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 914/1847] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:48.257597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc4105-7528-4b7a-9021-f618569b627a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.258070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc4105-7528-4b7a-9021-f618569b627a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.258561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc4105-7528-4b7a-9021-f618569b627a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.281745 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-babc4105-7528-4b7a-9021-f618569b627a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:48.283204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-babc4105-7528-4b7a-9021-f618569b627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:48.292071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 934/1848] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:48.296425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e95a3-f6c4-4d80-a0c1-56210aaa5bf0 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:48.307364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e95a3-f6c4-4d80-a0c1-56210aaa5bf0 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:48.313881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c79e2-8f1a-471e-8e7d-b7f4196a236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:48.313881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c79e2-8f1a-471e-8e7d-b7f4196a236a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.313881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c79e2-8f1a-471e-8e7d-b7f4196a236a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.313881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c79e2-8f1a-471e-8e7d-b7f4196a236a admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.314849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c79e2-8f1a-471e-8e7d-b7f4196a236a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:48.315699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c79e2-8f1a-471e-8e7d-b7f4196a236a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:48.318474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c79e2-8f1a-471e-8e7d-b7f4196a236a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:48.331334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 915/1849] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:48.336137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc4105-7528-4b7a-9021-f618569b627a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:48.345250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc4105-7528-4b7a-9021-f618569b627a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:48.350598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21b278-0db4-4d3d-96e2-1466e930a7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:48.351203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21b278-0db4-4d3d-96e2-1466e930a7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.351513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21b278-0db4-4d3d-96e2-1466e930a7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.351785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21b278-0db4-4d3d-96e2-1466e930a7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.352415 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21b278-0db4-4d3d-96e2-1466e930a7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:48.354330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21b278-0db4-4d3d-96e2-1466e930a7d8 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:48.457204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 935/1850] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:48 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:48.461611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c79e2-8f1a-471e-8e7d-b7f4196a236a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:48.477710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c79e2-8f1a-471e-8e7d-b7f4196a236a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:48.534548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:48.600181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442e736-86bf-4611-ae25-d950f46bcd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:48.600181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442e736-86bf-4611-ae25-d950f46bcd58 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.600181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442e736-86bf-4611-ae25-d950f46bcd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.600181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442e736-86bf-4611-ae25-d950f46bcd58 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.602976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442e736-86bf-4611-ae25-d950f46bcd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:48.609178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442e736-86bf-4611-ae25-d950f46bcd58 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:48.733567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 916/1851] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:48 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:48.735531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21b278-0db4-4d3d-96e2-1466e930a7d8 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:48.747835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21b278-0db4-4d3d-96e2-1466e930a7d8 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:48.753922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183c767-1158-4fdd-98a2-949617aa9a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:48.754541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c767-1158-4fdd-98a2-949617aa9a97 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.754817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c767-1158-4fdd-98a2-949617aa9a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.761192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c767-1158-4fdd-98a2-949617aa9a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.761192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183c767-1158-4fdd-98a2-949617aa9a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:48.761192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183c767-1158-4fdd-98a2-949617aa9a97 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:48.769510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 936/1852] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:48.772830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442e736-86bf-4611-ae25-d950f46bcd58 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:48.783067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442e736-86bf-4611-ae25-d950f46bcd58 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:48.788740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745740-a1e5-44b5-a4b8-b03911321b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:48.795808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745740-a1e5-44b5-a4b8-b03911321b90 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.795808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745740-a1e5-44b5-a4b8-b03911321b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.795808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9745740-a1e5-44b5-a4b8-b03911321b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.795808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9745740-a1e5-44b5-a4b8-b03911321b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:48.795808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9745740-a1e5-44b5-a4b8-b03911321b90 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:48.798605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183c767-1158-4fdd-98a2-949617aa9a97 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:48.800551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f183c767-1158-4fdd-98a2-949617aa9a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:48.804713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 917/1853] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:48.808745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745740-a1e5-44b5-a4b8-b03911321b90 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:48.819810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183c767-1158-4fdd-98a2-949617aa9a97 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:48.825065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9745740-a1e5-44b5-a4b8-b03911321b90 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:48.829377 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:48.830127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.830308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.830583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] PATH_INFO: `/v3/projects/c5cff7cb02254a5dbc946a8a70727840` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.830698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb938-1e47-4de5-8095-b1bf7f26eb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:48.831317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb938-1e47-4de5-8095-b1bf7f26eb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:48.831594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb938-1e47-4de5-8095-b1bf7f26eb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:48.831802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5cff7cb02254a5dbc946a8a70727840)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:48.831991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeb938-1e47-4de5-8095-b1bf7f26eb15 admin admin] PATH_INFO: `/v3/projects/0884b057a1b246c6878def0e85936ad7/users/913d348bd0dd4a78882349d55baefc19/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:48.834835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:48.858905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeb938-1e47-4de5-8095-b1bf7f26eb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0884b057a1b246c6878def0e85936ad7, user_id=913d348bd0dd4a78882349d55baefc19, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:48.861951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeb938-1e47-4de5-8095-b1bf7f26eb15 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:48.951644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 918/1854] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:48 2022] PUT /identity/v3/projects/0884b057a1b246c6878def0e85936ad7/users/913d348bd0dd4a78882349d55baefc19/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:48.952489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb938-1e47-4de5-8095-b1bf7f26eb15 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:48.955384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4cfeb938-1e47-4de5-8095-b1bf7f26eb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:48.975132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5cff7cb02254a5dbc946a8a70727840', 'request_id': 'req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:48.982345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5cff7cb02254a5dbc946a8a70727840', 'request_id': 'req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.024442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeb938-1e47-4de5-8095-b1bf7f26eb15 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:49.042832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5cff7cb02254a5dbc946a8a70727840', 'request_id': 'req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.054361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] The token cache is being invalidate because project c5cff7cb02254a5dbc946a8a70727840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:49.054651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.055354 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ff7dcdef-956f-4f54-a606-0eeaeb4bcc86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.056884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 937/1855] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:48 2022] DELETE /identity/v3/projects/c5cff7cb02254a5dbc946a8a70727840 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:49.058309 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb0e7-ec77-4900-8a84-2151502e332b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.058583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb0e7-ec77-4900-8a84-2151502e332b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.058852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb0e7-ec77-4900-8a84-2151502e332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.084565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:49.089545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:49.090762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.091295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.091574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] PATH_INFO: `/v3/projects/dd2a746cec5d4c05b5e936bdcad2ff10` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.092031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-1fbeb0e7-ec77-4900-8a84-2151502e332b None None] MFA Rules not processed for user `913d348bd0dd4a78882349d55baefc19`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:49.092752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2a746cec5d4c05b5e936bdcad2ff10)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:49.093449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1fbeb0e7-ec77-4900-8a84-2151502e332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:49.094699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:49.173496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 938/1856] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:49.175206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f64533-da63-4cbf-88dd-c08379fe6098 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.175820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f64533-da63-4cbf-88dd-c08379fe6098 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.176272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f64533-da63-4cbf-88dd-c08379fe6098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.186571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2a746cec5d4c05b5e936bdcad2ff10', 'request_id': 'req-29a0a270-0fb0-4c43-bb39-a51422920da7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.195287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2a746cec5d4c05b5e936bdcad2ff10', 'request_id': 'req-29a0a270-0fb0-4c43-bb39-a51422920da7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.199952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f2f64533-da63-4cbf-88dd-c08379fe6098 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:49.201572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f2f64533-da63-4cbf-88dd-c08379fe6098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:49.203387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2a746cec5d4c05b5e936bdcad2ff10', 'request_id': 'req-29a0a270-0fb0-4c43-bb39-a51422920da7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.289517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] The token cache is being invalidate because project dd2a746cec5d4c05b5e936bdcad2ff10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:49.290286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.292094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.299859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 919/1857] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:48 2022] DELETE /identity/v3/projects/dd2a746cec5d4c05b5e936bdcad2ff10 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:49.301472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:49.304129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:49.317973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 939/1858] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:49.320063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f64533-da63-4cbf-88dd-c08379fe6098 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:49.323090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a270-0fb0-4c43-bb39-a51422920da7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:49.324017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f2f64533-da63-4cbf-88dd-c08379fe6098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:49.331090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1f526-e6cf-429a-b273-daae805c832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:49.332304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f526-e6cf-429a-b273-daae805c832b admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.332904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f526-e6cf-429a-b273-daae805c832b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.334150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f526-e6cf-429a-b273-daae805c832b admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.335520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1f526-e6cf-429a-b273-daae805c832b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:49.339181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1f526-e6cf-429a-b273-daae805c832b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:49.341360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f64533-da63-4cbf-88dd-c08379fe6098 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:49.346991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:49.347783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.347985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.348249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] PATH_INFO: `/v3/users/3d5d57e48abf4cc7a60e10186aba10f1` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.350019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5d57e48abf4cc7a60e10186aba10f1)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:49.352999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:49.457104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 920/1859] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:49 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:49.457104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebba51-2c3c-4141-ba18-d7bbf84296aa None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.457104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebba51-2c3c-4141-ba18-d7bbf84296aa None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.457104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebba51-2c3c-4141-ba18-d7bbf84296aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.480179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-eaebba51-2c3c-4141-ba18-d7bbf84296aa None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:49.481381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-eaebba51-2c3c-4141-ba18-d7bbf84296aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:49.550747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5d57e48abf4cc7a60e10186aba10f1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.553785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5d57e48abf4cc7a60e10186aba10f1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.573571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 921/1860] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:49.575199 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebba51-2c3c-4141-ba18-d7bbf84296aa None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:49.577123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-eaebba51-2c3c-4141-ba18-d7bbf84296aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:49.592751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebba51-2c3c-4141-ba18-d7bbf84296aa None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:49.597841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1145c4b-7bca-4d19-bf9c-f92fd083b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:49.600724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1145c4b-7bca-4d19-bf9c-f92fd083b75b admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.601034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1145c4b-7bca-4d19-bf9c-f92fd083b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.601309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1145c4b-7bca-4d19-bf9c-f92fd083b75b admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.601965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1145c4b-7bca-4d19-bf9c-f92fd083b75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:49.603986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1145c4b-7bca-4d19-bf9c-f92fd083b75b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:49.674930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5d57e48abf4cc7a60e10186aba10f1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.684216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5d57e48abf4cc7a60e10186aba10f1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.713491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:49.724599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5d57e48abf4cc7a60e10186aba10f1'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:49.735860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 940/1861] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:49 2022] DELETE /identity/v3/users/3d5d57e48abf4cc7a60e10186aba10f1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:49.737462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:49.773531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 922/1862] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:49 2022] POST /identity/v3/users => generated 301 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:49.778515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1145c4b-7bca-4d19-bf9c-f92fd083b75b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:49.808687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1145c4b-7bca-4d19-bf9c-f92fd083b75b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:49.863921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7761b4-a98d-40ef-99d5-6b1a8799ae0e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:49.871136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d42bc-66c1-4b0c-94f7-584575539acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:49.872116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d42bc-66c1-4b0c-94f7-584575539acf admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.872558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d42bc-66c1-4b0c-94f7-584575539acf admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.873041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d42bc-66c1-4b0c-94f7-584575539acf admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.873874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d42bc-66c1-4b0c-94f7-584575539acf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:49.874346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d42bc-66c1-4b0c-94f7-584575539acf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:49.876497 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d42bc-66c1-4b0c-94f7-584575539acf admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:49.897420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 941/1863] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:49.904212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d42bc-66c1-4b0c-94f7-584575539acf admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:49.929697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d42bc-66c1-4b0c-94f7-584575539acf admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:49.938014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed6b0-0645-4b2c-963a-07023e8f4790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:49.938768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed6b0-0645-4b2c-963a-07023e8f4790 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.939156 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed6b0-0645-4b2c-963a-07023e8f4790 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.939358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ab4b-da3b-4eda-88a0-a09f2872dc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:49.939791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed6b0-0645-4b2c-963a-07023e8f4790 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.940038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ab4b-da3b-4eda-88a0-a09f2872dc60 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:49.940322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ab4b-da3b-4eda-88a0-a09f2872dc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:49.940597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ab4b-da3b-4eda-88a0-a09f2872dc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:49.940835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed6b0-0645-4b2c-963a-07023e8f4790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:49.941289 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9ab4b-da3b-4eda-88a0-a09f2872dc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:49.945382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed6b0-0645-4b2c-963a-07023e8f4790 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:49.965759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9ab4b-da3b-4eda-88a0-a09f2872dc60 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:50.010061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 923/1864] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:50.011286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ab4b-da3b-4eda-88a0-a09f2872dc60 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:50.024743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ab4b-da3b-4eda-88a0-a09f2872dc60 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:50.030262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df3435-2d3f-4ad7-876d-4b6b4f0d1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:50.031449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df3435-2d3f-4ad7-876d-4b6b4f0d1347 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:50.031449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df3435-2d3f-4ad7-876d-4b6b4f0d1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:50.031731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df3435-2d3f-4ad7-876d-4b6b4f0d1347 admin admin] PATH_INFO: `/v3/projects/6c97a3b43de7449dbd52afe7daedc595/users/7289e7ac92ac44eb89fe63d7780edfd9/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:50.050654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df3435-2d3f-4ad7-876d-4b6b4f0d1347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c97a3b43de7449dbd52afe7daedc595, user_id=7289e7ac92ac44eb89fe63d7780edfd9, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:50.055147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df3435-2d3f-4ad7-876d-4b6b4f0d1347 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:50.152982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 942/1865] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:49 2022] POST /identity/v3/projects => generated 399 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:59:50.157465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed6b0-0645-4b2c-963a-07023e8f4790 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:50.200268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:50.212337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 924/1866] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:50 2022] PUT /identity/v3/projects/6c97a3b43de7449dbd52afe7daedc595/users/7289e7ac92ac44eb89fe63d7780edfd9/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:50.216899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df3435-2d3f-4ad7-876d-4b6b4f0d1347 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:50.268185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed6b0-0645-4b2c-963a-07023e8f4790 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:50.305623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df3435-2d3f-4ad7-876d-4b6b4f0d1347 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:50.313818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d78be9-c59b-4cda-9ee5-3ea8e58c37ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:50.315377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78be9-c59b-4cda-9ee5-3ea8e58c37ba admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:50.315377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78be9-c59b-4cda-9ee5-3ea8e58c37ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:50.315377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78be9-c59b-4cda-9ee5-3ea8e58c37ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:50.315930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d78be9-c59b-4cda-9ee5-3ea8e58c37ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:50.319176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d78be9-c59b-4cda-9ee5-3ea8e58c37ba admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:50.337397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 925/1867] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:50.338518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d78be9-c59b-4cda-9ee5-3ea8e58c37ba admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:50.360238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d78be9-c59b-4cda-9ee5-3ea8e58c37ba admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:50.364275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf74a1-bc25-4ac1-99c2-172e89e32093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:50.366375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf74a1-bc25-4ac1-99c2-172e89e32093 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:50.366766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf74a1-bc25-4ac1-99c2-172e89e32093 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:50.367142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf74a1-bc25-4ac1-99c2-172e89e32093 admin admin] PATH_INFO: `/v3/projects/6c97a3b43de7449dbd52afe7daedc595/users/7289e7ac92ac44eb89fe63d7780edfd9/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:50.369809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf74a1-bc25-4ac1-99c2-172e89e32093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c97a3b43de7449dbd52afe7daedc595, user_id=7289e7ac92ac44eb89fe63d7780edfd9, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:50.373394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf74a1-bc25-4ac1-99c2-172e89e32093 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:50.374144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69c96c-d590-4c41-8bc3-7e012270b675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:50.374943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69c96c-d590-4c41-8bc3-7e012270b675 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:50.375443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69c96c-d590-4c41-8bc3-7e012270b675 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:50.375865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69c96c-d590-4c41-8bc3-7e012270b675 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:50.376862 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69c96c-d590-4c41-8bc3-7e012270b675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:50.381103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69c96c-d590-4c41-8bc3-7e012270b675 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:50.397974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 926/1868] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:50 2022] PUT /identity/v3/projects/6c97a3b43de7449dbd52afe7daedc595/users/7289e7ac92ac44eb89fe63d7780edfd9/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:50.408963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fefac-a6e0-4cf7-84c1-3f23b059618d None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:50.411390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fefac-a6e0-4cf7-84c1-3f23b059618d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:50.411390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fefac-a6e0-4cf7-84c1-3f23b059618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:50.454117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-a19fefac-a6e0-4cf7-84c1-3f23b059618d None None] MFA Rules not processed for user `7289e7ac92ac44eb89fe63d7780edfd9`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:50.455805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a19fefac-a6e0-4cf7-84c1-3f23b059618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:50.509563 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 943/1869] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:50 2022] POST /identity/v3/users => generated 300 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:50.510439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69c96c-d590-4c41-8bc3-7e012270b675 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:50.558968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69c96c-d590-4c41-8bc3-7e012270b675 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:50.617910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 927/1870] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:50.620834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fefac-a6e0-4cf7-84c1-3f23b059618d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:50.621178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a19fefac-a6e0-4cf7-84c1-3f23b059618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:50.712066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d2b5-4f4f-4543-8df7-b671d4e581e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:50.712728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d2b5-4f4f-4543-8df7-b671d4e581e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:50.713010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d2b5-4f4f-4543-8df7-b671d4e581e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:50.713335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d2b5-4f4f-4543-8df7-b671d4e581e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:50.719085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581d2b5-4f4f-4543-8df7-b671d4e581e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:50.721537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581d2b5-4f4f-4543-8df7-b671d4e581e8 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:50.747054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 944/1871] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:50.748317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fefac-a6e0-4cf7-84c1-3f23b059618d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:50.751441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d2b5-4f4f-4543-8df7-b671d4e581e8 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:50.775468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c76f4b-2a4e-4b7a-92ca-c6b50ecd6fa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:50.776106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c76f4b-2a4e-4b7a-92ca-c6b50ecd6fa8 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:50.776381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c76f4b-2a4e-4b7a-92ca-c6b50ecd6fa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:50.776654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c76f4b-2a4e-4b7a-92ca-c6b50ecd6fa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:50.796226 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d2b5-4f4f-4543-8df7-b671d4e581e8 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:50.816207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c76f4b-2a4e-4b7a-92ca-c6b50ecd6fa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:50.817668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c76f4b-2a4e-4b7a-92ca-c6b50ecd6fa8 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:50.820678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012061-c677-4eb4-a1bd-2efaf8502649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:50.821620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012061-c677-4eb4-a1bd-2efaf8502649 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:50.821896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012061-c677-4eb4-a1bd-2efaf8502649 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:50.822315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a012061-c677-4eb4-a1bd-2efaf8502649 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:50.823039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a012061-c677-4eb4-a1bd-2efaf8502649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:50.824974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a012061-c677-4eb4-a1bd-2efaf8502649 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:50.854340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 928/1872] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:50.862081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 945/1873] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:50.864114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c76f4b-2a4e-4b7a-92ca-c6b50ecd6fa8 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:50.915883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c76f4b-2a4e-4b7a-92ca-c6b50ecd6fa8 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:50.921118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da70fc-8d09-48e2-a862-abca1fedad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:50.921805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da70fc-8d09-48e2-a862-abca1fedad6b admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:50.922086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da70fc-8d09-48e2-a862-abca1fedad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:50.928602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da70fc-8d09-48e2-a862-abca1fedad6b admin admin] PATH_INFO: `/v3/projects/0155993cb587473691a76b466f0ed2fa/users/680ef42136254cd89a30532aaec548d3/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:50.995735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da70fc-8d09-48e2-a862-abca1fedad6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0155993cb587473691a76b466f0ed2fa, user_id=680ef42136254cd89a30532aaec548d3, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:50.998469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da70fc-8d09-48e2-a862-abca1fedad6b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:51.081902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012061-c677-4eb4-a1bd-2efaf8502649 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:51.093039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 929/1874] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:50 2022] PUT /identity/v3/projects/0155993cb587473691a76b466f0ed2fa/users/680ef42136254cd89a30532aaec548d3/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:51.099958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a012061-c677-4eb4-a1bd-2efaf8502649 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:51.105253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f058b7-f13e-4420-a82f-36b67b1be537 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:51.105583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f058b7-f13e-4420-a82f-36b67b1be537 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:51.105862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f058b7-f13e-4420-a82f-36b67b1be537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:51.183683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-12f058b7-f13e-4420-a82f-36b67b1be537 None None] MFA Rules not processed for user `680ef42136254cd89a30532aaec548d3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:51.186215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-12f058b7-f13e-4420-a82f-36b67b1be537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:51.285412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 930/1875] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:51.293454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:51.294114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:51.294403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:51.294679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] PATH_INFO: `/v3/users/913d348bd0dd4a78882349d55baefc19` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:51.296213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=913d348bd0dd4a78882349d55baefc19)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:51.297849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:51.299677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f058b7-f13e-4420-a82f-36b67b1be537 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:51.327014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f058b7-f13e-4420-a82f-36b67b1be537 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:51.344234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e76ff-c6f7-4773-8bfe-a22860e4a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:51.345102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e76ff-c6f7-4773-8bfe-a22860e4a493 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:51.360090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e76ff-c6f7-4773-8bfe-a22860e4a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:51.360090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e76ff-c6f7-4773-8bfe-a22860e4a493 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:51.360090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e76ff-c6f7-4773-8bfe-a22860e4a493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:51.360090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e76ff-c6f7-4773-8bfe-a22860e4a493 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:51.529921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 931/1876] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:51 2022] POST /identity/v3/projects => generated 399 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:51.530937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e76ff-c6f7-4773-8bfe-a22860e4a493 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:51.534686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4d0e76ff-c6f7-4773-8bfe-a22860e4a493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:51.569347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913d348bd0dd4a78882349d55baefc19'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:51.570173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913d348bd0dd4a78882349d55baefc19'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:51.714957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e76ff-c6f7-4773-8bfe-a22860e4a493 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:51.721787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:51.722767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:51.723809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:51.724105 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] PATH_INFO: `/v3/projects/e3a7d1da12264186ae63ea975baa010f` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:51.725574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a7d1da12264186ae63ea975baa010f)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:51.728423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:51.852536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913d348bd0dd4a78882349d55baefc19'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:51.853601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913d348bd0dd4a78882349d55baefc19'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:51.870934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913d348bd0dd4a78882349d55baefc19'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:51.884710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 946/1877] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:51 2022] DELETE /identity/v3/users/913d348bd0dd4a78882349d55baefc19 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:51.885706 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:51.888284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:51.912843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a7d1da12264186ae63ea975baa010f', 'request_id': 'req-50315d75-b8e2-4ddf-8fec-a5f698651386'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:51.922415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a7d1da12264186ae63ea975baa010f', 'request_id': 'req-50315d75-b8e2-4ddf-8fec-a5f698651386'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:51.931597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a7d1da12264186ae63ea975baa010f', 'request_id': 'req-50315d75-b8e2-4ddf-8fec-a5f698651386'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:52.015699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee29380-b9e5-412b-bf6a-f9fd6a183c90 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:52.066976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] The token cache is being invalidate because project e3a7d1da12264186ae63ea975baa010f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:52.067598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:52.068525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-50315d75-b8e2-4ddf-8fec-a5f698651386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:52.073656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 932/1878] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:51 2022] DELETE /identity/v3/projects/e3a7d1da12264186ae63ea975baa010f => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:52.073656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade4e8-ab72-4ffa-baf1-38897957e8d2 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.073656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade4e8-ab72-4ffa-baf1-38897957e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.073656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade4e8-ab72-4ffa-baf1-38897957e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.111449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-a6ade4e8-ab72-4ffa-baf1-38897957e8d2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:52.113141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a6ade4e8-ab72-4ffa-baf1-38897957e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:52.116139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebc623-a81b-43a0-bb9f-97b9f58e1343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:52.117597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc623-a81b-43a0-bb9f-97b9f58e1343 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.117597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc623-a81b-43a0-bb9f-97b9f58e1343 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.117597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebc623-a81b-43a0-bb9f-97b9f58e1343 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.117930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebc623-a81b-43a0-bb9f-97b9f58e1343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:52.119862 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebc623-a81b-43a0-bb9f-97b9f58e1343 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:52.132889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 933/1879] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:52.134207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e3b8-815a-44e0-9c51-36944b5f9db4 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.134497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e3b8-815a-44e0-9c51-36944b5f9db4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.134775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e3b8-815a-44e0-9c51-36944b5f9db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.168592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4599e3b8-815a-44e0-9c51-36944b5f9db4 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:52.171180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4599e3b8-815a-44e0-9c51-36944b5f9db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:52.181416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 934/1880] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:52.182546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599e3b8-815a-44e0-9c51-36944b5f9db4 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:52.184885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4599e3b8-815a-44e0-9c51-36944b5f9db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:52.265429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599e3b8-815a-44e0-9c51-36944b5f9db4 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:52.270591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2142fd-fef1-4ce3-9f31-5ec5027587db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:52.271897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2142fd-fef1-4ce3-9f31-5ec5027587db service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.272311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2142fd-fef1-4ce3-9f31-5ec5027587db service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.272590 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2142fd-fef1-4ce3-9f31-5ec5027587db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.288801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 947/1881] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:51 2022] POST /identity/v3/users => generated 306 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:52.290266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aca961-a401-45ca-82d7-fb7393acb219 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.290557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aca961-a401-45ca-82d7-fb7393acb219 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.292137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aca961-a401-45ca-82d7-fb7393acb219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.293866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2142fd-fef1-4ce3-9f31-5ec5027587db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:52.295604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2142fd-fef1-4ce3-9f31-5ec5027587db service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:52.309223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 935/1882] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:52.310388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2142fd-fef1-4ce3-9f31-5ec5027587db service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:52.312178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ec2142fd-fef1-4ce3-9f31-5ec5027587db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:52.331941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2142fd-fef1-4ce3-9f31-5ec5027587db service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:52.339505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a935fb-09cc-4cfa-a43e-8c442230f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:52.340949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a935fb-09cc-4cfa-a43e-8c442230f80f admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.341302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a935fb-09cc-4cfa-a43e-8c442230f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.341675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a935fb-09cc-4cfa-a43e-8c442230f80f admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.342375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a935fb-09cc-4cfa-a43e-8c442230f80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:52.344473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a935fb-09cc-4cfa-a43e-8c442230f80f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:52.360513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 936/1883] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:52.364152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a935fb-09cc-4cfa-a43e-8c442230f80f admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:52.375192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:52.383291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c1aca961-a401-45ca-82d7-fb7393acb219 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:52.385751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a935fb-09cc-4cfa-a43e-8c442230f80f admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:52.386279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c1aca961-a401-45ca-82d7-fb7393acb219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:52.392322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab3cd-db61-4ff3-84dc-b8d9c6d3e364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:52.393663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab3cd-db61-4ff3-84dc-b8d9c6d3e364 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.394453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab3cd-db61-4ff3-84dc-b8d9c6d3e364 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.394916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab3cd-db61-4ff3-84dc-b8d9c6d3e364 admin admin] PATH_INFO: `/v3/projects/532c8df8bdaa4c24a65932e879000429/users/243ad550daf1470381e6555d6b58eae8/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.418590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 948/1884] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:52.422916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab3cd-db61-4ff3-84dc-b8d9c6d3e364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532c8df8bdaa4c24a65932e879000429, user_id=243ad550daf1470381e6555d6b58eae8, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:52.424982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aca961-a401-45ca-82d7-fb7393acb219 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:52.427298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab3cd-db61-4ff3-84dc-b8d9c6d3e364 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:52.438554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aca961-a401-45ca-82d7-fb7393acb219 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:52.445511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552299-b871-4f99-80e1-699c4229b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:52.446542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552299-b871-4f99-80e1-699c4229b328 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.447099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552299-b871-4f99-80e1-699c4229b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.447513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552299-b871-4f99-80e1-699c4229b328 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.448333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552299-b871-4f99-80e1-699c4229b328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:52.448876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552299-b871-4f99-80e1-699c4229b328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:52.450945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552299-b871-4f99-80e1-699c4229b328 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:52.492829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 949/1885] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 19:59:52.497355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552299-b871-4f99-80e1-699c4229b328 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:52.517980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552299-b871-4f99-80e1-699c4229b328 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:52.522994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 937/1886] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:52 2022] PUT /identity/v3/projects/532c8df8bdaa4c24a65932e879000429/users/243ad550daf1470381e6555d6b58eae8/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:52.526894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab3cd-db61-4ff3-84dc-b8d9c6d3e364 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:52.630726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9920c-8191-4478-a60a-069e5f9e64fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:52.631374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9920c-8191-4478-a60a-069e5f9e64fe admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.631659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9920c-8191-4478-a60a-069e5f9e64fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.632109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9920c-8191-4478-a60a-069e5f9e64fe admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.632849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9920c-8191-4478-a60a-069e5f9e64fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:52.638703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9920c-8191-4478-a60a-069e5f9e64fe admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:52.666709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab3cd-db61-4ff3-84dc-b8d9c6d3e364 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:52.672843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa85e4-5fbe-4317-824e-e57aec9f9d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:52.673474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa85e4-5fbe-4317-824e-e57aec9f9d16 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.673752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa85e4-5fbe-4317-824e-e57aec9f9d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.674022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa85e4-5fbe-4317-824e-e57aec9f9d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.675215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa85e4-5fbe-4317-824e-e57aec9f9d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:52.676580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa85e4-5fbe-4317-824e-e57aec9f9d16 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:52.693481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 938/1887] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:59:52.697588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa85e4-5fbe-4317-824e-e57aec9f9d16 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:52.720263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa85e4-5fbe-4317-824e-e57aec9f9d16 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:52.727590 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82572b1-ade1-4e5e-8d32-f029a2c89aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:52.728283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82572b1-ade1-4e5e-8d32-f029a2c89aed admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.728599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82572b1-ade1-4e5e-8d32-f029a2c89aed admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.729068 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82572b1-ade1-4e5e-8d32-f029a2c89aed admin admin] PATH_INFO: `/v3/projects/532c8df8bdaa4c24a65932e879000429/users/243ad550daf1470381e6555d6b58eae8/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.731117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82572b1-ade1-4e5e-8d32-f029a2c89aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=532c8df8bdaa4c24a65932e879000429, user_id=243ad550daf1470381e6555d6b58eae8, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:52.736201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82572b1-ade1-4e5e-8d32-f029a2c89aed admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:52.761145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 939/1888] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:52 2022] PUT /identity/v3/projects/532c8df8bdaa4c24a65932e879000429/users/243ad550daf1470381e6555d6b58eae8/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:52.784918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700353f-d9d4-4ec0-91a7-c7db32faa689 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.785125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700353f-d9d4-4ec0-91a7-c7db32faa689 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.785311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700353f-d9d4-4ec0-91a7-c7db32faa689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.802617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 950/1889] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:52 2022] POST /identity/v3/projects => generated 383 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 19:59:52.805718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9920c-8191-4478-a60a-069e5f9e64fe admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:52.850010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4700353f-d9d4-4ec0-91a7-c7db32faa689 None None] MFA Rules not processed for user `243ad550daf1470381e6555d6b58eae8`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:52.852378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4700353f-d9d4-4ec0-91a7-c7db32faa689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:52.879781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:52.892453 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9920c-8191-4478-a60a-069e5f9e64fe admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:52.898298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e8fbb-fdfd-486c-9721-56317f6b7a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:52.899002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e8fbb-fdfd-486c-9721-56317f6b7a4d admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:52.899375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e8fbb-fdfd-486c-9721-56317f6b7a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:52.899713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e8fbb-fdfd-486c-9721-56317f6b7a4d admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:52.900410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e8fbb-fdfd-486c-9721-56317f6b7a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:52.902442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e8fbb-fdfd-486c-9721-56317f6b7a4d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:52.931791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 940/1890] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:52.943145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700353f-d9d4-4ec0-91a7-c7db32faa689 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:52.945053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4700353f-d9d4-4ec0-91a7-c7db32faa689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:53.003473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700353f-d9d4-4ec0-91a7-c7db32faa689 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:53.009552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f3e6d-e156-4dc4-af14-23083befb8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:53.010155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3e6d-e156-4dc4-af14-23083befb8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:53.010422 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3e6d-e156-4dc4-af14-23083befb8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:53.010686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f3e6d-e156-4dc4-af14-23083befb8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:53.021578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3e6d-e156-4dc4-af14-23083befb8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:53.021799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 951/1891] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:52 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:53.024677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f3e6d-e156-4dc4-af14-23083befb8e7 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:53.026081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e8fbb-fdfd-486c-9721-56317f6b7a4d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:53.041232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e8fbb-fdfd-486c-9721-56317f6b7a4d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:53.047353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 941/1892] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:53.047914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2190efb-9f97-4597-98a2-69037f873c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:53.048218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f3e6d-e156-4dc4-af14-23083befb8e7 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:53.049641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2190efb-9f97-4597-98a2-69037f873c8f admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:53.050346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2190efb-9f97-4597-98a2-69037f873c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:53.050857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2190efb-9f97-4597-98a2-69037f873c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:53.051982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2190efb-9f97-4597-98a2-69037f873c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:53.056847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2190efb-9f97-4597-98a2-69037f873c8f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:53.058799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b11f3e6d-e156-4dc4-af14-23083befb8e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:53.071002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 952/1893] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:53.076117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2190efb-9f97-4597-98a2-69037f873c8f admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:53.080206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f3e6d-e156-4dc4-af14-23083befb8e7 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:53.086473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:53.087208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:53.087458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:53.087730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] PATH_INFO: `/v3/projects/0884b057a1b246c6878def0e85936ad7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:53.088888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0884b057a1b246c6878def0e85936ad7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:53.091108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:53.105992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2190efb-9f97-4597-98a2-69037f873c8f admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:53.112907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42504cdd-faeb-403e-8821-ff0db5184dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:53.113527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42504cdd-faeb-403e-8821-ff0db5184dbf admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:53.113808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42504cdd-faeb-403e-8821-ff0db5184dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:53.114138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42504cdd-faeb-403e-8821-ff0db5184dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:53.114896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42504cdd-faeb-403e-8821-ff0db5184dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:53.117550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42504cdd-faeb-403e-8821-ff0db5184dbf admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:53.132238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 953/1894] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:53.133529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42504cdd-faeb-403e-8821-ff0db5184dbf admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:53.143547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42504cdd-faeb-403e-8821-ff0db5184dbf admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:53.149119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a13e54-e9bf-4b62-8d4b-2287b4135931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:53.154694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a13e54-e9bf-4b62-8d4b-2287b4135931 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:53.154694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a13e54-e9bf-4b62-8d4b-2287b4135931 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:53.154694 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a13e54-e9bf-4b62-8d4b-2287b4135931 admin admin] PATH_INFO: `/v3/projects/e9f35ca051c6402ca86b7ecd3b31fda8/users/4dca87dea0f14a37bf16019ee695ec10/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:53.172952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a13e54-e9bf-4b62-8d4b-2287b4135931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f35ca051c6402ca86b7ecd3b31fda8, user_id=4dca87dea0f14a37bf16019ee695ec10, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:53.175854 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a13e54-e9bf-4b62-8d4b-2287b4135931 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:53.279289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 954/1895] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:53 2022] PUT /identity/v3/projects/e9f35ca051c6402ca86b7ecd3b31fda8/users/4dca87dea0f14a37bf16019ee695ec10/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:53.280948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a13e54-e9bf-4b62-8d4b-2287b4135931 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:53.282803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-81a13e54-e9bf-4b62-8d4b-2287b4135931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:53.305139 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0884b057a1b246c6878def0e85936ad7', 'request_id': 'req-a19bc492-037d-4581-b98e-a9f222e72c11'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:53.311800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0884b057a1b246c6878def0e85936ad7', 'request_id': 'req-a19bc492-037d-4581-b98e-a9f222e72c11'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:53.321495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0884b057a1b246c6878def0e85936ad7', 'request_id': 'req-a19bc492-037d-4581-b98e-a9f222e72c11'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:53.366428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a13e54-e9bf-4b62-8d4b-2287b4135931 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:53.395015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] The token cache is being invalidate because project 0884b057a1b246c6878def0e85936ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:53.395015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:53.395015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a19bc492-037d-4581-b98e-a9f222e72c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:53.396399 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 942/1896] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:53 2022] DELETE /identity/v3/projects/0884b057a1b246c6878def0e85936ad7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:53.399941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd83a3-8901-4cad-b184-acebeb06e751 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:53.399941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd83a3-8901-4cad-b184-acebeb06e751 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:53.399941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd83a3-8901-4cad-b184-acebeb06e751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:53.434602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-3fcd83a3-8901-4cad-b184-acebeb06e751 None None] MFA Rules not processed for user `4dca87dea0f14a37bf16019ee695ec10`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:53.435802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3fcd83a3-8901-4cad-b184-acebeb06e751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:53.450988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:53.451775 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:53.452160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:53.452552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:53.455561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:53.523740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 943/1897] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:53.524590 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd83a3-8901-4cad-b184-acebeb06e751 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:53.525905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3fcd83a3-8901-4cad-b184-acebeb06e751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:53.526540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:53.528041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:53.538731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 955/1898] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:53.539905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:53.541340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:53.612667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd83a3-8901-4cad-b184-acebeb06e751 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:53.620159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:53.620918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:53.621283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:53.621953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] PATH_INFO: `/v3/users/7289e7ac92ac44eb89fe63d7780edfd9` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:53.632032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7289e7ac92ac44eb89fe63d7780edfd9)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:53.632032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:53.632255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c1f5-559d-400d-babc-caff93d816a5 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:53.637335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b600a-6393-47c7-920a-dcc56c249822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:53.638020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b600a-6393-47c7-920a-dcc56c249822 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:53.638437 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b600a-6393-47c7-920a-dcc56c249822 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:53.638633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b600a-6393-47c7-920a-dcc56c249822 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:53.639386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b600a-6393-47c7-920a-dcc56c249822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:53.641649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b600a-6393-47c7-920a-dcc56c249822 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:54.002755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 956/1899] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:53 2022] POST /identity/v3/projects => generated 383 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:54.006377 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7df0-f90c-4dbc-91a2-c87d149eec77 None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:54.011418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7df0-f90c-4dbc-91a2-c87d149eec77 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:54.011534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7289e7ac92ac44eb89fe63d7780edfd9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:54.011640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7df0-f90c-4dbc-91a2-c87d149eec77 None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:54.011727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7289e7ac92ac44eb89fe63d7780edfd9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:54.011811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 957/1900] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 19:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 19:59:54.011811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7df0-f90c-4dbc-91a2-c87d149eec77 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:54.011811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-aa4a7df0-f90c-4dbc-91a2-c87d149eec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:54.021308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7289e7ac92ac44eb89fe63d7780edfd9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:54.079094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7289e7ac92ac44eb89fe63d7780edfd9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:54.082735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7df0-f90c-4dbc-91a2-c87d149eec77 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:54.101283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29260935-8186-46b5-a4d5-fe1964bff0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:54.101931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29260935-8186-46b5-a4d5-fe1964bff0ea admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:54.102213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29260935-8186-46b5-a4d5-fe1964bff0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:54.102489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29260935-8186-46b5-a4d5-fe1964bff0ea admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:54.103142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29260935-8186-46b5-a4d5-fe1964bff0ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:54.105271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29260935-8186-46b5-a4d5-fe1964bff0ea admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:54.119530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-81faf128-3590-400b-8405-02293d6bb08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7289e7ac92ac44eb89fe63d7780edfd9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:54.131977 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 944/1901] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:53 2022] DELETE /identity/v3/users/7289e7ac92ac44eb89fe63d7780edfd9 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:54.133681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270dcf0-bbc8-4b84-8e8d-eaf4bffde2fc None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:54.133971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270dcf0-bbc8-4b84-8e8d-eaf4bffde2fc None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:54.134249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270dcf0-bbc8-4b84-8e8d-eaf4bffde2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:54.169800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7270dcf0-bbc8-4b84-8e8d-eaf4bffde2fc None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:54.175309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7270dcf0-bbc8-4b84-8e8d-eaf4bffde2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:54.287027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 958/1902] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:54 2022] POST /identity/v3/users => generated 298 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:54.298645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 945/1903] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 19:59:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:54.302223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29260935-8186-46b5-a4d5-fe1964bff0ea admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:54.315688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270dcf0-bbc8-4b84-8e8d-eaf4bffde2fc None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:54.320122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7270dcf0-bbc8-4b84-8e8d-eaf4bffde2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:54.343538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29260935-8186-46b5-a4d5-fe1964bff0ea admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:54.343642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270dcf0-bbc8-4b84-8e8d-eaf4bffde2fc None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:54.366999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb09a82-c1ed-4613-b9fd-cb9a3430eae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:54.369561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09a82-c1ed-4613-b9fd-cb9a3430eae5 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:54.369561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09a82-c1ed-4613-b9fd-cb9a3430eae5 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:54.369561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb09a82-c1ed-4613-b9fd-cb9a3430eae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:54.398580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb09a82-c1ed-4613-b9fd-cb9a3430eae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:54.406607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb09a82-c1ed-4613-b9fd-cb9a3430eae5 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:54.434237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 946/1904] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:54.527984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe7bc2-b15d-468f-88e4-ddeabfa4dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:54.528850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7bc2-b15d-468f-88e4-ddeabfa4dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:54.529273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7bc2-b15d-468f-88e4-ddeabfa4dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:54.529710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7bc2-b15d-468f-88e4-ddeabfa4dda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:54.530516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe7bc2-b15d-468f-88e4-ddeabfa4dda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:54.532524 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe7bc2-b15d-468f-88e4-ddeabfa4dda7 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:54.556268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 959/1905] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 19:59:54.556409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb09a82-c1ed-4613-b9fd-cb9a3430eae5 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:54.567945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb09a82-c1ed-4613-b9fd-cb9a3430eae5 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:54.574443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cc8dd-b8e9-4a06-a3d6-00dc891aac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:54.575196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc8dd-b8e9-4a06-a3d6-00dc891aac5d admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:54.575535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc8dd-b8e9-4a06-a3d6-00dc891aac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:54.575873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cc8dd-b8e9-4a06-a3d6-00dc891aac5d admin admin] PATH_INFO: `/v3/projects/6fc1b778eb9548098ebe8148571743e5/users/8279af5cf8cf445f9463a1a4d826ccb3/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:54.602673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cc8dd-b8e9-4a06-a3d6-00dc891aac5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc1b778eb9548098ebe8148571743e5, user_id=8279af5cf8cf445f9463a1a4d826ccb3, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:54.608852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cc8dd-b8e9-4a06-a3d6-00dc891aac5d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:54.810720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 947/1906] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:54 2022] PUT /identity/v3/projects/6fc1b778eb9548098ebe8148571743e5/users/8279af5cf8cf445f9463a1a4d826ccb3/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:54.815517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe7bc2-b15d-468f-88e4-ddeabfa4dda7 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:54.827106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe7bc2-b15d-468f-88e4-ddeabfa4dda7 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:54.936163 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0126fc5-b4fa-439f-9346-282896524dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:54.937099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126fc5-b4fa-439f-9346-282896524dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:54.937594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126fc5-b4fa-439f-9346-282896524dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:54.938036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0126fc5-b4fa-439f-9346-282896524dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:54.939725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0126fc5-b4fa-439f-9346-282896524dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:54.942139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0126fc5-b4fa-439f-9346-282896524dd2 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:54.971247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 960/1907] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:54.975976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cc8dd-b8e9-4a06-a3d6-00dc891aac5d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:54.999124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cc8dd-b8e9-4a06-a3d6-00dc891aac5d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:55.008016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cd8a2-95a4-4486-a089-cc5d02faf3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:55.008702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cd8a2-95a4-4486-a089-cc5d02faf3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:55.008976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cd8a2-95a4-4486-a089-cc5d02faf3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:55.009251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cd8a2-95a4-4486-a089-cc5d02faf3b7 admin admin] PATH_INFO: `/v3/projects/6fc1b778eb9548098ebe8148571743e5/users/8279af5cf8cf445f9463a1a4d826ccb3/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:55.011453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cd8a2-95a4-4486-a089-cc5d02faf3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc1b778eb9548098ebe8148571743e5, user_id=8279af5cf8cf445f9463a1a4d826ccb3, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:55.014252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cd8a2-95a4-4486-a089-cc5d02faf3b7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:55.026585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 948/1908] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:54 2022] PUT /identity/v3/projects/6fc1b778eb9548098ebe8148571743e5/users/8279af5cf8cf445f9463a1a4d826ccb3/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:55.040773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dde87-2368-4c1a-ad16-d06ba49c597d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:55.041427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dde87-2368-4c1a-ad16-d06ba49c597d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:55.041427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dde87-2368-4c1a-ad16-d06ba49c597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:55.076731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-a76dde87-2368-4c1a-ad16-d06ba49c597d None None] MFA Rules not processed for user `8279af5cf8cf445f9463a1a4d826ccb3`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:55.078682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a76dde87-2368-4c1a-ad16-d06ba49c597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:55.174799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cd8a2-95a4-4486-a089-cc5d02faf3b7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:55.184605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5e4cd8a2-95a4-4486-a089-cc5d02faf3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:55.202036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 961/1909] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:55.215633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dde87-2368-4c1a-ad16-d06ba49c597d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:55.217446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a76dde87-2368-4c1a-ad16-d06ba49c597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:55.293369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cd8a2-95a4-4486-a089-cc5d02faf3b7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:55.299842 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:55.300509 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:55.300881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:55.301084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] PATH_INFO: `/v3/projects/6c97a3b43de7449dbd52afe7daedc595` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:55.303616 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c97a3b43de7449dbd52afe7daedc595)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:55.303933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dde87-2368-4c1a-ad16-d06ba49c597d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:55.305255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:55.307664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef86b35-08e3-4b79-95af-5d504cbb46fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:55.308369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef86b35-08e3-4b79-95af-5d504cbb46fa service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:55.308793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef86b35-08e3-4b79-95af-5d504cbb46fa service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:55.308942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef86b35-08e3-4b79-95af-5d504cbb46fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:55.320934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef86b35-08e3-4b79-95af-5d504cbb46fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:55.322744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef86b35-08e3-4b79-95af-5d504cbb46fa service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:55.335349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 962/1910] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:55.377592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:55.468089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c97a3b43de7449dbd52afe7daedc595', 'request_id': 'req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:55.475059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c97a3b43de7449dbd52afe7daedc595', 'request_id': 'req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:55.481591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c97a3b43de7449dbd52afe7daedc595', 'request_id': 'req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:55.584838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] The token cache is being invalidate because project 6c97a3b43de7449dbd52afe7daedc595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:55.585303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:55.586267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b0dfd7d0-aa13-48da-afc7-ab1b8114a973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:55.589530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef86b35-08e3-4b79-95af-5d504cbb46fa service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:55.593073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 949/1911] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:55 2022] DELETE /identity/v3/projects/6c97a3b43de7449dbd52afe7daedc595 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:55.598303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8118bc6-b732-4905-a53d-7c2aa70e8a46 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:55.598571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8118bc6-b732-4905-a53d-7c2aa70e8a46 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:55.599398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8118bc6-b732-4905-a53d-7c2aa70e8a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:55.599749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef86b35-08e3-4b79-95af-5d504cbb46fa service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:55.647651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e8118bc6-b732-4905-a53d-7c2aa70e8a46 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:55.648871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e8118bc6-b732-4905-a53d-7c2aa70e8a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:55.669860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a020a5-b38a-4ce9-8bef-6248d15103ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:55.670430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a020a5-b38a-4ce9-8bef-6248d15103ba service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:55.670892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a020a5-b38a-4ce9-8bef-6248d15103ba service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:55.671338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a020a5-b38a-4ce9-8bef-6248d15103ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:55.673364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c1a020a5-b38a-4ce9-8bef-6248d15103ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:55.746818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 950/1912] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:55.761281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2af1-a101-422a-91fe-1d3207d7f8e7 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:55.761557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2af1-a101-422a-91fe-1d3207d7f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:55.761829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2af1-a101-422a-91fe-1d3207d7f8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:55.766621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a020a5-b38a-4ce9-8bef-6248d15103ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:55.768367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a020a5-b38a-4ce9-8bef-6248d15103ba service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:55.780358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 963/1913] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:55.788866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-d6cc2af1-a101-422a-91fe-1d3207d7f8e7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:55.790848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d6cc2af1-a101-422a-91fe-1d3207d7f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:55.808857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a020a5-b38a-4ce9-8bef-6248d15103ba service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:55.809669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:55.815886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 951/1914] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:55.822546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a020a5-b38a-4ce9-8bef-6248d15103ba service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:55.827524 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424d638-6c67-4dc5-aa07-56c88050dc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:55.828308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424d638-6c67-4dc5-aa07-56c88050dc6e admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:55.828589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424d638-6c67-4dc5-aa07-56c88050dc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:55.828859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424d638-6c67-4dc5-aa07-56c88050dc6e admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:55.829518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424d638-6c67-4dc5-aa07-56c88050dc6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 19:59:55.829826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424d638-6c67-4dc5-aa07-56c88050dc6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:55.831817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424d638-6c67-4dc5-aa07-56c88050dc6e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:55.860025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 964/1915] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 19:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 19:59:55.862683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2af1-a101-422a-91fe-1d3207d7f8e7 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:55.874792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2af1-a101-422a-91fe-1d3207d7f8e7 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:55.888185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4412cf-ff88-40c4-b78b-f4962de1a4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:55.888185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4412cf-ff88-40c4-b78b-f4962de1a4da admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:55.888185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4412cf-ff88-40c4-b78b-f4962de1a4da admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:55.888185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4412cf-ff88-40c4-b78b-f4962de1a4da admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:55.888699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4412cf-ff88-40c4-b78b-f4962de1a4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:55.888699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4412cf-ff88-40c4-b78b-f4962de1a4da admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:56.016061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 952/1916] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 19:59:55 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:56.017226 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424d638-6c67-4dc5-aa07-56c88050dc6e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:56.031252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424d638-6c67-4dc5-aa07-56c88050dc6e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:56.163154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f2138-101e-47fc-9ea2-5334c56a8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:56.163820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f2138-101e-47fc-9ea2-5334c56a8553 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:56.164077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f2138-101e-47fc-9ea2-5334c56a8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:56.164453 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f2138-101e-47fc-9ea2-5334c56a8553 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:56.165189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f2138-101e-47fc-9ea2-5334c56a8553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:56.167473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f2138-101e-47fc-9ea2-5334c56a8553 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:56.334925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 965/1917] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 19:59:56 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 19:59:56.336375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4412cf-ff88-40c4-b78b-f4962de1a4da admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:56.368953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4412cf-ff88-40c4-b78b-f4962de1a4da admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:56.387737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b8cdf-3037-4287-b2ff-407dd622e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:56.388493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b8cdf-3037-4287-b2ff-407dd622e114 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:56.389643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b8cdf-3037-4287-b2ff-407dd622e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:56.389995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b8cdf-3037-4287-b2ff-407dd622e114 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:56.391360 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b8cdf-3037-4287-b2ff-407dd622e114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:56.393133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b8cdf-3037-4287-b2ff-407dd622e114 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:56.423215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 953/1918] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:56.429012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f2138-101e-47fc-9ea2-5334c56a8553 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:56.445210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f2138-101e-47fc-9ea2-5334c56a8553 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:56.454033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9165f6e-2928-4d02-a4fe-330adf6ccc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:56.455288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9165f6e-2928-4d02-a4fe-330adf6ccc35 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:56.455901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9165f6e-2928-4d02-a4fe-330adf6ccc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:56.456334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9165f6e-2928-4d02-a4fe-330adf6ccc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:56.457239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9165f6e-2928-4d02-a4fe-330adf6ccc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:56.461195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9165f6e-2928-4d02-a4fe-330adf6ccc35 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:56.491677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 966/1919] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 19:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 19:59:56.502570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b8cdf-3037-4287-b2ff-407dd622e114 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:56.525326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b8cdf-3037-4287-b2ff-407dd622e114 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:56.537007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f028c8-f217-40e5-b81a-2b00da77b5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:56.538811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f028c8-f217-40e5-b81a-2b00da77b5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:56.539430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f028c8-f217-40e5-b81a-2b00da77b5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:56.539871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f028c8-f217-40e5-b81a-2b00da77b5f5 admin admin] PATH_INFO: `/v3/projects/520ae6dbea00410f823d425afca33486/users/5ad3f642f57941bf99c0c34125a5e4c2/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:56.562671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f028c8-f217-40e5-b81a-2b00da77b5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520ae6dbea00410f823d425afca33486, user_id=5ad3f642f57941bf99c0c34125a5e4c2, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:56.565839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f028c8-f217-40e5-b81a-2b00da77b5f5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:56.622747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9165f6e-2928-4d02-a4fe-330adf6ccc35 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:56.624696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d9165f6e-2928-4d02-a4fe-330adf6ccc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:56.658830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9165f6e-2928-4d02-a4fe-330adf6ccc35 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:56.679104 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:56.679885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:56.680238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:56.680611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] PATH_INFO: `/v3/users/4dca87dea0f14a37bf16019ee695ec10` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:56.682168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dca87dea0f14a37bf16019ee695ec10)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:56.684352 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:56.740283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 954/1920] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 19:59:56 2022] PUT /identity/v3/projects/520ae6dbea00410f823d425afca33486/users/5ad3f642f57941bf99c0c34125a5e4c2/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:56.752158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac583db-86aa-4beb-89ec-d438b3e3cd66 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:56.752440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac583db-86aa-4beb-89ec-d438b3e3cd66 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:56.752820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac583db-86aa-4beb-89ec-d438b3e3cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:56.786588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-cac583db-86aa-4beb-89ec-d438b3e3cd66 None None] MFA Rules not processed for user `5ad3f642f57941bf99c0c34125a5e4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:56.788827 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cac583db-86aa-4beb-89ec-d438b3e3cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:56.892681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 955/1921] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 19:59:56.907265 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac583db-86aa-4beb-89ec-d438b3e3cd66 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:56.908575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cac583db-86aa-4beb-89ec-d438b3e3cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:56.917795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dca87dea0f14a37bf16019ee695ec10'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:56.918720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dca87dea0f14a37bf16019ee695ec10'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:56.994523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dca87dea0f14a37bf16019ee695ec10'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:57.007521 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dca87dea0f14a37bf16019ee695ec10'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:57.037954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6ce82f6c-31ae-406d-8089-a2a725087826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dca87dea0f14a37bf16019ee695ec10'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:57.039633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac583db-86aa-4beb-89ec-d438b3e3cd66 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:57.050341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 967/1922] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:56 2022] DELETE /identity/v3/users/4dca87dea0f14a37bf16019ee695ec10 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:57.055193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4414630bb2da4523906f0b2dee0c4c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:57.055193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:57.055193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:57.055193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:57.057673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6619ac6-4543-4409-93a1-eac83744186f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:57.058307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6619ac6-4543-4409-93a1-eac83744186f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:57.058841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6619ac6-4543-4409-93a1-eac83744186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:57.059777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:57.075635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:57.077275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:57.085924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c6619ac6-4543-4409-93a1-eac83744186f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 19:59:57.088051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c6619ac6-4543-4409-93a1-eac83744186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:57.090798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 956/1923] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 19:59:57.195471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 968/1924] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 19:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 19:59:57.208948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:57.209603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:57.326720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f37eaa-a78b-42b7-9fa6-dca1ab470a31 service glance] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:57.410823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49c4cb-0692-4413-831a-e2069545e036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:57.411604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49c4cb-0692-4413-831a-e2069545e036 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:57.412138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49c4cb-0692-4413-831a-e2069545e036 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:57.412535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49c4cb-0692-4413-831a-e2069545e036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:57.425587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49c4cb-0692-4413-831a-e2069545e036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:57.427792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49c4cb-0692-4413-831a-e2069545e036 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:57.443969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 957/1925] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 19:59:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 19:59:58.343637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6619ac6-4543-4409-93a1-eac83744186f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:58.345182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c6619ac6-4543-4409-93a1-eac83744186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:58.360695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6619ac6-4543-4409-93a1-eac83744186f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:58.365915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:58.369442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:58.369442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:58.369442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] PATH_INFO: `/v3/projects/e9f35ca051c6402ca86b7ecd3b31fda8` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:58.369442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f35ca051c6402ca86b7ecd3b31fda8)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:58.372633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:58.438954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:58.523254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f35ca051c6402ca86b7ecd3b31fda8', 'request_id': 'req-5af34169-ec80-4678-b1e6-ccbad1d14251'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:58.530588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f35ca051c6402ca86b7ecd3b31fda8', 'request_id': 'req-5af34169-ec80-4678-b1e6-ccbad1d14251'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:58.643596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f35ca051c6402ca86b7ecd3b31fda8', 'request_id': 'req-5af34169-ec80-4678-b1e6-ccbad1d14251'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:58.667260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] The token cache is being invalidate because project e9f35ca051c6402ca86b7ecd3b31fda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 19:59:58.667556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:58.668224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:58.673113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 969/1926] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:58 2022] DELETE /identity/v3/projects/e9f35ca051c6402ca86b7ecd3b31fda8 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 19:59:58.674245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49c4cb-0692-4413-831a-e2069545e036 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:58.685280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49c4cb-0692-4413-831a-e2069545e036 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:58.785238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:58.787128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:58.787749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:58.788161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] PATH_INFO: `/v3/users/8279af5cf8cf445f9463a1a4d826ccb3` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:58.790743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8279af5cf8cf445f9463a1a4d826ccb3)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:58.793745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 19:59:58.829468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 19:59:59.055577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8279af5cf8cf445f9463a1a4d826ccb3'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:59.059810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8279af5cf8cf445f9463a1a4d826ccb3'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:59.066234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8279af5cf8cf445f9463a1a4d826ccb3'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:59.161119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8279af5cf8cf445f9463a1a4d826ccb3'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:59.182666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e35dbae0-db34-43a8-9c11-df92cb566a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8279af5cf8cf445f9463a1a4d826ccb3'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 19:59:59.199425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 958/1927] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 19:59:58 2022] DELETE /identity/v3/users/8279af5cf8cf445f9463a1a4d826ccb3 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 19:59:59.876431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 19:59:59.878052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 19:59:59.900427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af34169-ec80-4678-b1e6-ccbad1d14251 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 19:59:59.972069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 19:59:59.972730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 19:59:59.973001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 19:59:59.973280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] PATH_INFO: `/v3/projects/6fc1b778eb9548098ebe8148571743e5` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 19:59:59.974834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc1b778eb9548098ebe8148571743e5)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 19:59:59.976841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:00.131905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc1b778eb9548098ebe8148571743e5', 'request_id': 'req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:00.142495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc1b778eb9548098ebe8148571743e5', 'request_id': 'req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:00.223482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc1b778eb9548098ebe8148571743e5', 'request_id': 'req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:00.241424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] The token cache is being invalidate because project 6fc1b778eb9548098ebe8148571743e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:00.241424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:00.241424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0eca46cc-e70f-4aa9-b0a8-41eaac48e97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:00.243455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 970/1928] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 19:59:59 2022] DELETE /identity/v3/projects/6fc1b778eb9548098ebe8148571743e5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:00.252313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b499166-bda1-4cd5-9f4c-1866aef8a2fd None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:00.253019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b499166-bda1-4cd5-9f4c-1866aef8a2fd None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:00.253262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b499166-bda1-4cd5-9f4c-1866aef8a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:00.285563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6b499166-bda1-4cd5-9f4c-1866aef8a2fd None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:00.287450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6b499166-bda1-4cd5-9f4c-1866aef8a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:00.320722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:00.363987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 959/1929] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:00.372973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cfa7a-4105-4fbd-b214-b89907bd26b6 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:00.375762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cfa7a-4105-4fbd-b214-b89907bd26b6 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:00.375762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cfa7a-4105-4fbd-b214-b89907bd26b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:00.426778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7a7cfa7a-4105-4fbd-b214-b89907bd26b6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:00.435257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7a7cfa7a-4105-4fbd-b214-b89907bd26b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:00.463129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 971/1930] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:00.465018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b499166-bda1-4cd5-9f4c-1866aef8a2fd None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:00.485052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b499166-bda1-4cd5-9f4c-1866aef8a2fd None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:00.499090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81bacc-2475-41a4-9c6e-e503d71eda16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:00.501197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81bacc-2475-41a4-9c6e-e503d71eda16 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:00.501490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81bacc-2475-41a4-9c6e-e503d71eda16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:00.501768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81bacc-2475-41a4-9c6e-e503d71eda16 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:00.502462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81bacc-2475-41a4-9c6e-e503d71eda16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:00.502767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81bacc-2475-41a4-9c6e-e503d71eda16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:00.520565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81bacc-2475-41a4-9c6e-e503d71eda16 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:00.541798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 960/1931] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:00.546470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cfa7a-4105-4fbd-b214-b89907bd26b6 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:00.568029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cfa7a-4105-4fbd-b214-b89907bd26b6 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:00.573323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4247a88-bc3c-4de0-b52b-fd670f9ff8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:00.574300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4247a88-bc3c-4de0-b52b-fd670f9ff8ff admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:00.574300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4247a88-bc3c-4de0-b52b-fd670f9ff8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:00.574506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4247a88-bc3c-4de0-b52b-fd670f9ff8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:00.575149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4247a88-bc3c-4de0-b52b-fd670f9ff8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:00.577420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4247a88-bc3c-4de0-b52b-fd670f9ff8ff admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:00.612738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:00.703582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 972/1932] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:00 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:00.711274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81bacc-2475-41a4-9c6e-e503d71eda16 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:00.735564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81bacc-2475-41a4-9c6e-e503d71eda16 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:00.809606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4247a88-bc3c-4de0-b52b-fd670f9ff8ff admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:00.813511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a4247a88-bc3c-4de0-b52b-fd670f9ff8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:00.832099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5962c-688c-4733-8663-b414786895b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:00.834253 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5962c-688c-4733-8663-b414786895b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:00.834541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5962c-688c-4733-8663-b414786895b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:00.834986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5962c-688c-4733-8663-b414786895b7 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:00.835918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5962c-688c-4733-8663-b414786895b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:00.837954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5962c-688c-4733-8663-b414786895b7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:00.923558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4247a88-bc3c-4de0-b52b-fd670f9ff8ff admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:00.933486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:00.937347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:00.937347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:00.937347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] PATH_INFO: `/v3/users/680ef42136254cd89a30532aaec548d3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:00.937347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=680ef42136254cd89a30532aaec548d3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:00.938148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:00.966211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 961/1933] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:00 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:00.967266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5962c-688c-4733-8663-b414786895b7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:00.978384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5962c-688c-4733-8663-b414786895b7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:00.983980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3a55a-59cd-479c-bc30-49f6ad4fef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:00.985063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3a55a-59cd-479c-bc30-49f6ad4fef5b admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:00.985336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3a55a-59cd-479c-bc30-49f6ad4fef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:00.985606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3a55a-59cd-479c-bc30-49f6ad4fef5b admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:00.986288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3a55a-59cd-479c-bc30-49f6ad4fef5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:00.987973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3a55a-59cd-479c-bc30-49f6ad4fef5b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:00.999386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 962/1934] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:01.003498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3a55a-59cd-479c-bc30-49f6ad4fef5b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:01.014567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3a55a-59cd-479c-bc30-49f6ad4fef5b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:01.019662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d1823-d1fe-4d40-a841-87ed5f9f0bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:01.020129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1823-d1fe-4d40-a841-87ed5f9f0bef admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:01.021203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1823-d1fe-4d40-a841-87ed5f9f0bef admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:01.021463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d1823-d1fe-4d40-a841-87ed5f9f0bef admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:01.021922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d1823-d1fe-4d40-a841-87ed5f9f0bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:01.023677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d1823-d1fe-4d40-a841-87ed5f9f0bef admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:01.035172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 963/1935] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:01.040196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d1823-d1fe-4d40-a841-87ed5f9f0bef admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:01.051606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d1823-d1fe-4d40-a841-87ed5f9f0bef admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:01.060031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b52f4-bef7-4219-a862-70aee9fa0d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:01.060708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b52f4-bef7-4219-a862-70aee9fa0d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:01.060982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b52f4-bef7-4219-a862-70aee9fa0d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:01.062298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b52f4-bef7-4219-a862-70aee9fa0d84 admin admin] PATH_INFO: `/v3/projects/f11fb89ff0bb4c529bc9d523a3b58f63/users/9984855ce18a4bf59e5eb91642ffc701/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:01.077689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b52f4-bef7-4219-a862-70aee9fa0d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11fb89ff0bb4c529bc9d523a3b58f63, user_id=9984855ce18a4bf59e5eb91642ffc701, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:01.080506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b52f4-bef7-4219-a862-70aee9fa0d84 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:01.127019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680ef42136254cd89a30532aaec548d3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:01.127950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680ef42136254cd89a30532aaec548d3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:01.186532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 964/1936] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:01 2022] PUT /identity/v3/projects/f11fb89ff0bb4c529bc9d523a3b58f63/users/9984855ce18a4bf59e5eb91642ffc701/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:01.192271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac9c9b-7afa-46d5-ac35-595638abc2ec None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:01.193393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac9c9b-7afa-46d5-ac35-595638abc2ec None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:01.193393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac9c9b-7afa-46d5-ac35-595638abc2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:01.219760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680ef42136254cd89a30532aaec548d3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:01.224065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b0ac9c9b-7afa-46d5-ac35-595638abc2ec None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:01.225423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b0ac9c9b-7afa-46d5-ac35-595638abc2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:01.233357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680ef42136254cd89a30532aaec548d3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:01.253277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e19bebb-8e7d-48cd-827c-3ab2a918c63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680ef42136254cd89a30532aaec548d3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:01.269710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 973/1937] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:00 2022] DELETE /identity/v3/users/680ef42136254cd89a30532aaec548d3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:01.275166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345e86a-3fda-41c1-b691-52ea339c7208 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:01.275516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345e86a-3fda-41c1-b691-52ea339c7208 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:01.276086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345e86a-3fda-41c1-b691-52ea339c7208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:01.307540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d345e86a-3fda-41c1-b691-52ea339c7208 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:01.310564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d345e86a-3fda-41c1-b691-52ea339c7208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:01.354421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 965/1938] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:01.359050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac9c9b-7afa-46d5-ac35-595638abc2ec None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:01.361159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b0ac9c9b-7afa-46d5-ac35-595638abc2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:01.408211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 974/1939] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:01.426395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345e86a-3fda-41c1-b691-52ea339c7208 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:01.428198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d345e86a-3fda-41c1-b691-52ea339c7208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:01.455920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac9c9b-7afa-46d5-ac35-595638abc2ec None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:01.510592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345e86a-3fda-41c1-b691-52ea339c7208 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:01.516009 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5200-1356-42ff-8a13-e617c7f648c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:01.516827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5200-1356-42ff-8a13-e617c7f648c6 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:01.517169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5200-1356-42ff-8a13-e617c7f648c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:01.517530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa5200-1356-42ff-8a13-e617c7f648c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:01.531431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa5200-1356-42ff-8a13-e617c7f648c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:01.533126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa5200-1356-42ff-8a13-e617c7f648c6 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:01.533679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90207c1-3f83-4a27-9ec1-c40c739b5d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:01.534504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90207c1-3f83-4a27-9ec1-c40c739b5d1d service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:01.534906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90207c1-3f83-4a27-9ec1-c40c739b5d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:01.535318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90207c1-3f83-4a27-9ec1-c40c739b5d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:01.546494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 975/1940] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:00:01.546701 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90207c1-3f83-4a27-9ec1-c40c739b5d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:01.548292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90207c1-3f83-4a27-9ec1-c40c739b5d1d service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:01.571160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 966/1941] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:00:01.881164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:02.253793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5200-1356-42ff-8a13-e617c7f648c6 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:02.255524 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4eaa5200-1356-42ff-8a13-e617c7f648c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:02.270302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa5200-1356-42ff-8a13-e617c7f648c6 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:02.275367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:02.279635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:02.306640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:02.306640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:02.306640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] PATH_INFO: `/v3/projects/0155993cb587473691a76b466f0ed2fa` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:02.306640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0155993cb587473691a76b466f0ed2fa)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:02.306640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:02.457326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0155993cb587473691a76b466f0ed2fa', 'request_id': 'req-cdb7c965-402e-4432-8d9d-1d96f410f001'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:02.471035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0155993cb587473691a76b466f0ed2fa', 'request_id': 'req-cdb7c965-402e-4432-8d9d-1d96f410f001'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:02.572800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0155993cb587473691a76b466f0ed2fa', 'request_id': 'req-cdb7c965-402e-4432-8d9d-1d96f410f001'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:02.589554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] The token cache is being invalidate because project 0155993cb587473691a76b466f0ed2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:02.589554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:02.590233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:02.592048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 976/1942] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:02 2022] DELETE /identity/v3/projects/0155993cb587473691a76b466f0ed2fa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:02.597951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90207c1-3f83-4a27-9ec1-c40c739b5d1d service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:02.611479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90207c1-3f83-4a27-9ec1-c40c739b5d1d service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:02.713353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:02.714089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:02.714537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:02.715249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] PATH_INFO: `/v3/users/243ad550daf1470381e6555d6b58eae8` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:02.717558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=243ad550daf1470381e6555d6b58eae8)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:02.720721 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:02.969590 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '243ad550daf1470381e6555d6b58eae8'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:02.970186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '243ad550daf1470381e6555d6b58eae8'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:02.984042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '243ad550daf1470381e6555d6b58eae8'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:03.071780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '243ad550daf1470381e6555d6b58eae8'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:03.085487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c4896dd5-5a17-4f47-be4e-914690c0e8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '243ad550daf1470381e6555d6b58eae8'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:03.092850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 967/1943] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:02 2022] DELETE /identity/v3/users/243ad550daf1470381e6555d6b58eae8 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:03.733010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:03.738000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:03.774173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7c965-402e-4432-8d9d-1d96f410f001 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:03.856987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:03.857665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:03.857946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:03.859619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] PATH_INFO: `/v3/projects/532c8df8bdaa4c24a65932e879000429` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:03.862386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=532c8df8bdaa4c24a65932e879000429)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:03.866282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:04.006055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:04.017328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532c8df8bdaa4c24a65932e879000429', 'request_id': 'req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.026618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532c8df8bdaa4c24a65932e879000429', 'request_id': 'req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.165809 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532c8df8bdaa4c24a65932e879000429', 'request_id': 'req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.183495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] The token cache is being invalidate because project 532c8df8bdaa4c24a65932e879000429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:04.184489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.185379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.187371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 977/1944] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:03 2022] DELETE /identity/v3/projects/532c8df8bdaa4c24a65932e879000429 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:04.192855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4908d-7441-4fb3-897b-388747ce503b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:04.194360 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4908d-7441-4fb3-897b-388747ce503b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:04.195132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4908d-7441-4fb3-897b-388747ce503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:04.223769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-bbf4908d-7441-4fb3-897b-388747ce503b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:04.225409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bbf4908d-7441-4fb3-897b-388747ce503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:04.362617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:04.365042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:04.423006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 968/1945] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:04.438586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11562b5-1847-49d9-ae7f-b5bbe95d7b7e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:04.439583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11562b5-1847-49d9-ae7f-b5bbe95d7b7e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:04.439583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11562b5-1847-49d9-ae7f-b5bbe95d7b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:04.469924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:04.497316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40524f-fc98-415a-8c54-3eaddaa7dc8c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:04.498964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-f11562b5-1847-49d9-ae7f-b5bbe95d7b7e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:04.500467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f11562b5-1847-49d9-ae7f-b5bbe95d7b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:04.502721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:04.503623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:04.503903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:04.504353 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] PATH_INFO: `/v3/users/582c18bfa529474bab35b13eabab3bdc` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:04.505811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=582c18bfa529474bab35b13eabab3bdc)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:04.508103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:04.518993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 969/1946] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:04.523860 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11562b5-1847-49d9-ae7f-b5bbe95d7b7e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:04.542791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11562b5-1847-49d9-ae7f-b5bbe95d7b7e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:04.552791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40f2ad-0397-409d-ab0a-aec923140e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:04.553544 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40f2ad-0397-409d-ab0a-aec923140e90 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:04.553651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40f2ad-0397-409d-ab0a-aec923140e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:04.553935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40f2ad-0397-409d-ab0a-aec923140e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:04.554683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40f2ad-0397-409d-ab0a-aec923140e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:04.555996 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40f2ad-0397-409d-ab0a-aec923140e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:04.560829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40f2ad-0397-409d-ab0a-aec923140e90 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:04.585429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 970/1947] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:04.591661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40f2ad-0397-409d-ab0a-aec923140e90 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:04.604803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40f2ad-0397-409d-ab0a-aec923140e90 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:04.611562 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2dae9-78ae-4206-9349-63eec0b25d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:04.612296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2dae9-78ae-4206-9349-63eec0b25d8e admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:04.613104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2dae9-78ae-4206-9349-63eec0b25d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:04.613104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2dae9-78ae-4206-9349-63eec0b25d8e admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:04.613752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2dae9-78ae-4206-9349-63eec0b25d8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:04.616051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2dae9-78ae-4206-9349-63eec0b25d8e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:04.737757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582c18bfa529474bab35b13eabab3bdc'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.739091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582c18bfa529474bab35b13eabab3bdc'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.765130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 971/1948] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:04 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:04.769343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2dae9-78ae-4206-9349-63eec0b25d8e admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:04.772678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-11f2dae9-78ae-4206-9349-63eec0b25d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:04.846914 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582c18bfa529474bab35b13eabab3bdc'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.857214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582c18bfa529474bab35b13eabab3bdc'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.951925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-258a4948-4909-42c8-9501-cb2e9d22cbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582c18bfa529474bab35b13eabab3bdc'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:04.952175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2dae9-78ae-4206-9349-63eec0b25d8e admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:04.965295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c200a-b9cc-4129-85be-b7bca77be8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:04.965935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c200a-b9cc-4129-85be-b7bca77be8dc admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:04.966212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c200a-b9cc-4129-85be-b7bca77be8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:04.966555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c200a-b9cc-4129-85be-b7bca77be8dc admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:04.967410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c200a-b9cc-4129-85be-b7bca77be8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:04.968534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 978/1949] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:04 2022] DELETE /identity/v3/users/582c18bfa529474bab35b13eabab3bdc => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:04.972392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c200a-b9cc-4129-85be-b7bca77be8dc admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:04.975021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff33920-f64f-457f-96d0-6dbc048b2fab None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:04.975548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff33920-f64f-457f-96d0-6dbc048b2fab None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:04.978582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff33920-f64f-457f-96d0-6dbc048b2fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:05.049665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-dff33920-f64f-457f-96d0-6dbc048b2fab None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:05.050903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dff33920-f64f-457f-96d0-6dbc048b2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:05.121962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 972/1950] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:04 2022] POST /identity/v3/users => generated 287 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:05.123851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c200a-b9cc-4129-85be-b7bca77be8dc admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:05.138069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c200a-b9cc-4129-85be-b7bca77be8dc admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:05.188225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 979/1951] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:05.196284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff33920-f64f-457f-96d0-6dbc048b2fab None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:05.199448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dff33920-f64f-457f-96d0-6dbc048b2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:05.302549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d36a8-7ccf-44dd-9c5a-09a6eb572eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:05.303122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d36a8-7ccf-44dd-9c5a-09a6eb572eeb admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:05.304965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d36a8-7ccf-44dd-9c5a-09a6eb572eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:05.305285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d36a8-7ccf-44dd-9c5a-09a6eb572eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:05.306064 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d36a8-7ccf-44dd-9c5a-09a6eb572eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:05.323309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d36a8-7ccf-44dd-9c5a-09a6eb572eeb admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:05.334034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff33920-f64f-457f-96d0-6dbc048b2fab None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:05.368548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 973/1952] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:05.368548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d36a8-7ccf-44dd-9c5a-09a6eb572eeb admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:05.368904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa80869-3b40-45b2-8a18-94f00fb7b7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:05.368904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa80869-3b40-45b2-8a18-94f00fb7b7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:05.368904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa80869-3b40-45b2-8a18-94f00fb7b7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:05.368904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa80869-3b40-45b2-8a18-94f00fb7b7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:05.379382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d36a8-7ccf-44dd-9c5a-09a6eb572eeb admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:05.384284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa80869-3b40-45b2-8a18-94f00fb7b7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:05.385771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa80869-3b40-45b2-8a18-94f00fb7b7d9 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:05.400885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376c0e7-770a-400b-b477-72f3dfc4aa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:05.402341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c0e7-770a-400b-b477-72f3dfc4aa97 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:05.402607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c0e7-770a-400b-b477-72f3dfc4aa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:05.402916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c0e7-770a-400b-b477-72f3dfc4aa97 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:05.403692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376c0e7-770a-400b-b477-72f3dfc4aa97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:05.405326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376c0e7-770a-400b-b477-72f3dfc4aa97 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:05.422466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 974/1953] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:05.428304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376c0e7-770a-400b-b477-72f3dfc4aa97 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:05.440649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 980/1954] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:00:05.451608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376c0e7-770a-400b-b477-72f3dfc4aa97 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:05.457687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0eba-88fe-47d8-89df-84a4ebab79d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:05.458250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0eba-88fe-47d8-89df-84a4ebab79d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:05.458489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0eba-88fe-47d8-89df-84a4ebab79d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:05.460364 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a0eba-88fe-47d8-89df-84a4ebab79d0 admin admin] PATH_INFO: `/v3/projects/78f1eb2ddcf84a90917960c114a393c9/users/7244451548bb4058bf9927a16b3af61b/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:05.475919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a0eba-88fe-47d8-89df-84a4ebab79d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f1eb2ddcf84a90917960c114a393c9, user_id=7244451548bb4058bf9927a16b3af61b, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:05.478692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a0eba-88fe-47d8-89df-84a4ebab79d0 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:05.569818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 975/1955] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:05 2022] PUT /identity/v3/projects/78f1eb2ddcf84a90917960c114a393c9/users/7244451548bb4058bf9927a16b3af61b/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:05.575934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a61c0-9894-4012-92e3-eac1964101cd None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:05.576256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a61c0-9894-4012-92e3-eac1964101cd None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:05.577238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a61c0-9894-4012-92e3-eac1964101cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:05.605134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-004a61c0-9894-4012-92e3-eac1964101cd None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:05.606498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-004a61c0-9894-4012-92e3-eac1964101cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:05.678077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 981/1956] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:05.688293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0eba-88fe-47d8-89df-84a4ebab79d0 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:05.690339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-333a0eba-88fe-47d8-89df-84a4ebab79d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:05.782142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a0eba-88fe-47d8-89df-84a4ebab79d0 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:05.789175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76feb902-e64e-4beb-829d-44628ea823f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:05.789652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76feb902-e64e-4beb-829d-44628ea823f7 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:05.789931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76feb902-e64e-4beb-829d-44628ea823f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:05.790197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76feb902-e64e-4beb-829d-44628ea823f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:05.808195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76feb902-e64e-4beb-829d-44628ea823f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:05.810112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76feb902-e64e-4beb-829d-44628ea823f7 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:05.822795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 976/1957] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:05.826056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:06.003403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:06.118874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a61c0-9894-4012-92e3-eac1964101cd None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:06.120432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-004a61c0-9894-4012-92e3-eac1964101cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:06.136103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a61c0-9894-4012-92e3-eac1964101cd None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:06.138641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:06.139413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:06.139792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:06.140141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] PATH_INFO: `/v3/projects/9b9fdd6e83e64fceb9183ad28b536aae` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:06.141449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9fdd6e83e64fceb9183ad28b536aae)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:06.143565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:06.273029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9fdd6e83e64fceb9183ad28b536aae', 'request_id': 'req-dbd808df-b439-4179-b4cb-127ef91b0828'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.280586 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9fdd6e83e64fceb9183ad28b536aae', 'request_id': 'req-dbd808df-b439-4179-b4cb-127ef91b0828'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.369971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9fdd6e83e64fceb9183ad28b536aae', 'request_id': 'req-dbd808df-b439-4179-b4cb-127ef91b0828'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.392961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] The token cache is being invalidate because project 9b9fdd6e83e64fceb9183ad28b536aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:06.393334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.394126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.400655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 982/1958] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:06 2022] DELETE /identity/v3/projects/9b9fdd6e83e64fceb9183ad28b536aae => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:06.401748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76feb902-e64e-4beb-829d-44628ea823f7 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:06.419290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76feb902-e64e-4beb-829d-44628ea823f7 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:06.497757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:06.498714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:06.499284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:06.499693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] PATH_INFO: `/v3/users/c4d3449e34e14cd6ae5e18c1feb56ad0` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:06.500989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d3449e34e14cd6ae5e18c1feb56ad0)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:06.503359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:06.818826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d3449e34e14cd6ae5e18c1feb56ad0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.819575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d3449e34e14cd6ae5e18c1feb56ad0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.830930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d3449e34e14cd6ae5e18c1feb56ad0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.934997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d3449e34e14cd6ae5e18c1feb56ad0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.965992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-8b497b1e-525e-4e73-8a55-a943cccd897c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d3449e34e14cd6ae5e18c1feb56ad0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:06.975072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 977/1959] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:06 2022] DELETE /identity/v3/users/c4d3449e34e14cd6ae5e18c1feb56ad0 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:07.140396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:07.267942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:07.881421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:07.882947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:07.903439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd808df-b439-4179-b4cb-127ef91b0828 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:08.044167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:08.049898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:08.049898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:08.049898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] PATH_INFO: `/v3/projects/65042ac75112403caa6639d158222a6e` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:08.049898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=65042ac75112403caa6639d158222a6e)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:08.049898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:08.168737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b887a-1497-495f-955e-9f39bf66dc50 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:08.169718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b887a-1497-495f-955e-9f39bf66dc50 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:08.170143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b887a-1497-495f-955e-9f39bf66dc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:08.226307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65042ac75112403caa6639d158222a6e', 'request_id': 'req-7587b3b8-b6b8-4057-b946-4f891f6684cb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:08.230799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-aa6b887a-1497-495f-955e-9f39bf66dc50 None None] MFA Rules not processed for user `7244451548bb4058bf9927a16b3af61b`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:08.241180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65042ac75112403caa6639d158222a6e', 'request_id': 'req-7587b3b8-b6b8-4057-b946-4f891f6684cb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:08.243659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-aa6b887a-1497-495f-955e-9f39bf66dc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:08.344339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65042ac75112403caa6639d158222a6e', 'request_id': 'req-7587b3b8-b6b8-4057-b946-4f891f6684cb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:08.359626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] The token cache is being invalidate because project 65042ac75112403caa6639d158222a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:08.359934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:08.363664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-7587b3b8-b6b8-4057-b946-4f891f6684cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:08.366531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 983/1960] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:07 2022] DELETE /identity/v3/projects/65042ac75112403caa6639d158222a6e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:08.372178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c8277-5831-4ad1-9cd5-58d444e36584 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:08.372652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c8277-5831-4ad1-9cd5-58d444e36584 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:08.373069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c8277-5831-4ad1-9cd5-58d444e36584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:08.381786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 978/1961] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:08.386614 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b887a-1497-495f-955e-9f39bf66dc50 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:08.389031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-aa6b887a-1497-495f-955e-9f39bf66dc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:08.435635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-607c8277-5831-4ad1-9cd5-58d444e36584 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:08.437203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-607c8277-5831-4ad1-9cd5-58d444e36584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:08.517160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b887a-1497-495f-955e-9f39bf66dc50 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:08.525182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a700f9-463c-4b46-acf4-f56d0be95895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:08.525843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a700f9-463c-4b46-acf4-f56d0be95895 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:08.526123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a700f9-463c-4b46-acf4-f56d0be95895 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:08.527997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a700f9-463c-4b46-acf4-f56d0be95895 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:08.528810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a700f9-463c-4b46-acf4-f56d0be95895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:08.532121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:08.534582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a700f9-463c-4b46-acf4-f56d0be95895 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:08.585110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 984/1962] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:08.598323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c515e-1dd2-4b28-95f1-67b7e21398aa None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:08.600386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c515e-1dd2-4b28-95f1-67b7e21398aa None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:08.600821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c515e-1dd2-4b28-95f1-67b7e21398aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:08.653584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-1e8c515e-1dd2-4b28-95f1-67b7e21398aa None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:08.657387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1e8c515e-1dd2-4b28-95f1-67b7e21398aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:08.669700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 979/1963] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:08 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:08.673909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a700f9-463c-4b46-acf4-f56d0be95895 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:08.678032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-56a700f9-463c-4b46-acf4-f56d0be95895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:08.710677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 985/1964] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:08.713766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c515e-1dd2-4b28-95f1-67b7e21398aa None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:08.737791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c515e-1dd2-4b28-95f1-67b7e21398aa None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:08.837432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a700f9-463c-4b46-acf4-f56d0be95895 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:08.870986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24222fbe-4399-4bf9-9557-74894175e8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:08.874056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24222fbe-4399-4bf9-9557-74894175e8fa admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:08.874339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24222fbe-4399-4bf9-9557-74894175e8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:08.874615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24222fbe-4399-4bf9-9557-74894175e8fa admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:08.875278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24222fbe-4399-4bf9-9557-74894175e8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:08.887207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24222fbe-4399-4bf9-9557-74894175e8fa admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:08.977286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:08.994803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879217f-30af-4d9a-82d2-f01eb89279b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.000087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879217f-30af-4d9a-82d2-f01eb89279b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.003345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879217f-30af-4d9a-82d2-f01eb89279b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.006096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879217f-30af-4d9a-82d2-f01eb89279b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.006990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879217f-30af-4d9a-82d2-f01eb89279b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:09.007300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879217f-30af-4d9a-82d2-f01eb89279b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.010498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879217f-30af-4d9a-82d2-f01eb89279b6 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:09.023756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 980/1965] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:08 2022] POST /identity/v3/users => generated 293 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:09.028382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24222fbe-4399-4bf9-9557-74894175e8fa admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:09.078068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 986/1966] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:00:09.079841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24222fbe-4399-4bf9-9557-74894175e8fa admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:09.084560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879217f-30af-4d9a-82d2-f01eb89279b6 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:09.099811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae291e-39f8-4e13-a77a-5726f8d7e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.100638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae291e-39f8-4e13-a77a-5726f8d7e862 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.100915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae291e-39f8-4e13-a77a-5726f8d7e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.101352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae291e-39f8-4e13-a77a-5726f8d7e862 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.102234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae291e-39f8-4e13-a77a-5726f8d7e862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.103873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae291e-39f8-4e13-a77a-5726f8d7e862 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:09.120334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 981/1967] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:09.121440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae291e-39f8-4e13-a77a-5726f8d7e862 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:09.122863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879217f-30af-4d9a-82d2-f01eb89279b6 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:09.133456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae291e-39f8-4e13-a77a-5726f8d7e862 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:09.139647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ccd7-1f4f-41c5-9af8-896107380d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.140444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ccd7-1f4f-41c5-9af8-896107380d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.140830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ccd7-1f4f-41c5-9af8-896107380d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.141382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430ccd7-1f4f-41c5-9af8-896107380d33 admin admin] PATH_INFO: `/v3/projects/de8fdd6b915c4d39931c8dec892370f9/users/ee03387c96a04d5cbc9ec33a8a3b27af/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.151922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c629ec-9675-44b7-8099-b4e43ba26a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.152820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c629ec-9675-44b7-8099-b4e43ba26a3c admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.153254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c629ec-9675-44b7-8099-b4e43ba26a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.153866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c629ec-9675-44b7-8099-b4e43ba26a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.154794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c629ec-9675-44b7-8099-b4e43ba26a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.160112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c629ec-9675-44b7-8099-b4e43ba26a3c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:09.160281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430ccd7-1f4f-41c5-9af8-896107380d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8fdd6b915c4d39931c8dec892370f9, user_id=ee03387c96a04d5cbc9ec33a8a3b27af, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.169413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3430ccd7-1f4f-41c5-9af8-896107380d33 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:09.276264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 982/1968] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:09 2022] PUT /identity/v3/projects/de8fdd6b915c4d39931c8dec892370f9/users/ee03387c96a04d5cbc9ec33a8a3b27af/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:09.292826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 987/1969] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:09 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:09.296644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c629ec-9675-44b7-8099-b4e43ba26a3c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:09.297697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ccd7-1f4f-41c5-9af8-896107380d33 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:09.436938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c629ec-9675-44b7-8099-b4e43ba26a3c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:09.451132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be68af-f75c-4190-ab0c-8db386ea8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.451813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be68af-f75c-4190-ab0c-8db386ea8f3b admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.453253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be68af-f75c-4190-ab0c-8db386ea8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.453558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be68af-f75c-4190-ab0c-8db386ea8f3b admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.454979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be68af-f75c-4190-ab0c-8db386ea8f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.475932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be68af-f75c-4190-ab0c-8db386ea8f3b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:09.543640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430ccd7-1f4f-41c5-9af8-896107380d33 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:09.563940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d983ff-fd34-4fe1-bb0c-77022c006d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.564571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d983ff-fd34-4fe1-bb0c-77022c006d19 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.564848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d983ff-fd34-4fe1-bb0c-77022c006d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.566161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d983ff-fd34-4fe1-bb0c-77022c006d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.568297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d983ff-fd34-4fe1-bb0c-77022c006d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.574179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d983ff-fd34-4fe1-bb0c-77022c006d19 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:09.604884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 983/1970] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:09.616641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d983ff-fd34-4fe1-bb0c-77022c006d19 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:09.637683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 988/1971] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:09 2022] POST /identity/v3/users => generated 284 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:09.637892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d983ff-fd34-4fe1-bb0c-77022c006d19 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:09.639705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be68af-f75c-4190-ab0c-8db386ea8f3b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:09.643809 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:09.649976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6674f-cc23-47f2-a263-8a80a74f0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.653550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6674f-cc23-47f2-a263-8a80a74f0685 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.653550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6674f-cc23-47f2-a263-8a80a74f0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.653550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6674f-cc23-47f2-a263-8a80a74f0685 admin admin] PATH_INFO: `/v3/projects/de8fdd6b915c4d39931c8dec892370f9/users/ee03387c96a04d5cbc9ec33a8a3b27af/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.656455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6674f-cc23-47f2-a263-8a80a74f0685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8fdd6b915c4d39931c8dec892370f9, user_id=ee03387c96a04d5cbc9ec33a8a3b27af, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.660952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6674f-cc23-47f2-a263-8a80a74f0685 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:09.674518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be68af-f75c-4190-ab0c-8db386ea8f3b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:09.681975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 984/1972] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:09 2022] PUT /identity/v3/projects/de8fdd6b915c4d39931c8dec892370f9/users/ee03387c96a04d5cbc9ec33a8a3b27af/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:09.838280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d809e9a-3641-41f3-a898-4d1fae294b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.838921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d809e9a-3641-41f3-a898-4d1fae294b29 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.839205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d809e9a-3641-41f3-a898-4d1fae294b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.839533 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d809e9a-3641-41f3-a898-4d1fae294b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.840282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d809e9a-3641-41f3-a898-4d1fae294b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.842087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d809e9a-3641-41f3-a898-4d1fae294b29 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:09.860170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 989/1973] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:09.862011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6674f-cc23-47f2-a263-8a80a74f0685 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:09.879627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6674f-cc23-47f2-a263-8a80a74f0685 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:09.886657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88c50b-5e9b-4701-bc61-2634a058b24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.888390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88c50b-5e9b-4701-bc61-2634a058b24a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.888588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88c50b-5e9b-4701-bc61-2634a058b24a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.888876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88c50b-5e9b-4701-bc61-2634a058b24a admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.889756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88c50b-5e9b-4701-bc61-2634a058b24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.892099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88c50b-5e9b-4701-bc61-2634a058b24a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:09.907310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 985/1974] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:09.911128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d809e9a-3641-41f3-a898-4d1fae294b29 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:09.927174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d809e9a-3641-41f3-a898-4d1fae294b29 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:09.934002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edec5a-d134-435f-9fe5-2fad502f7daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:09.934953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edec5a-d134-435f-9fe5-2fad502f7daf admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:09.935251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edec5a-d134-435f-9fe5-2fad502f7daf admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:09.935634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edec5a-d134-435f-9fe5-2fad502f7daf admin admin] PATH_INFO: `/v3/projects/0f40b809f09040dd8a303685bdff2f2d/users/1aebca4cfa52410c8e1892441706c042/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:09.972491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edec5a-d134-435f-9fe5-2fad502f7daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f40b809f09040dd8a303685bdff2f2d, user_id=1aebca4cfa52410c8e1892441706c042, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:09.976886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edec5a-d134-435f-9fe5-2fad502f7daf admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:10.072063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 990/1975] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:09 2022] PUT /identity/v3/projects/0f40b809f09040dd8a303685bdff2f2d/users/1aebca4cfa52410c8e1892441706c042/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:10.085489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc4c17-8811-434a-94bd-7c5c301c39d8 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:10.085826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc4c17-8811-434a-94bd-7c5c301c39d8 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:10.086109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc4c17-8811-434a-94bd-7c5c301c39d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:10.119104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:10.131994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-65bc4c17-8811-434a-94bd-7c5c301c39d8 None None] MFA Rules not processed for user `1aebca4cfa52410c8e1892441706c042`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:10.134284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-65bc4c17-8811-434a-94bd-7c5c301c39d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:10.146655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:10.269272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 986/1976] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:10.275333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edec5a-d134-435f-9fe5-2fad502f7daf admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:10.366112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edec5a-d134-435f-9fe5-2fad502f7daf admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:10.371271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7111ad-d00f-4240-87aa-30d905538d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:10.372446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7111ad-d00f-4240-87aa-30d905538d2c admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:10.372800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7111ad-d00f-4240-87aa-30d905538d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:10.373138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7111ad-d00f-4240-87aa-30d905538d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:10.373865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7111ad-d00f-4240-87aa-30d905538d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:10.377493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7111ad-d00f-4240-87aa-30d905538d2c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:10.525772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 991/1977] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:10 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:10.531632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc4c17-8811-434a-94bd-7c5c301c39d8 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:10.571914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc4c17-8811-434a-94bd-7c5c301c39d8 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:10.697772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9d97-f6b7-4d54-b0c2-5037c4f04aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:10.698723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9d97-f6b7-4d54-b0c2-5037c4f04aaf admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:10.699162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9d97-f6b7-4d54-b0c2-5037c4f04aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:10.699768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9d97-f6b7-4d54-b0c2-5037c4f04aaf admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:10.700588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a9d97-f6b7-4d54-b0c2-5037c4f04aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:10.703554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a9d97-f6b7-4d54-b0c2-5037c4f04aaf admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:10.844015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 987/1978] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:10 2022] POST /identity/v3/users => generated 291 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:10.847892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7111ad-d00f-4240-87aa-30d905538d2c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:10.861555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7111ad-d00f-4240-87aa-30d905538d2c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:10.868240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1352d5-242d-4fae-bef7-e03844e8565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:10.869132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1352d5-242d-4fae-bef7-e03844e8565a admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:10.873801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1352d5-242d-4fae-bef7-e03844e8565a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:10.873801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1352d5-242d-4fae-bef7-e03844e8565a admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:10.873801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1352d5-242d-4fae-bef7-e03844e8565a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:10.873801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1352d5-242d-4fae-bef7-e03844e8565a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:10.893202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9d97-f6b7-4d54-b0c2-5037c4f04aaf admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:10.902793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 992/1979] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:10.906169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a9d97-f6b7-4d54-b0c2-5037c4f04aaf admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:10.920743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03735cc-48c5-4b9e-be4b-a981f5df0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:10.921439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03735cc-48c5-4b9e-be4b-a981f5df0c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:10.922376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03735cc-48c5-4b9e-be4b-a981f5df0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:10.922750 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03735cc-48c5-4b9e-be4b-a981f5df0c6d admin admin] PATH_INFO: `/v3/projects/e082281818d545d584aab4f1739adc63/users/e933bc34ab9c4f3899a028ce9de211ca/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:10.956281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03735cc-48c5-4b9e-be4b-a981f5df0c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e082281818d545d584aab4f1739adc63, user_id=e933bc34ab9c4f3899a028ce9de211ca, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:10.962526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03735cc-48c5-4b9e-be4b-a981f5df0c6d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:11.270585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 988/1980] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:10 2022] PUT /identity/v3/projects/e082281818d545d584aab4f1739adc63/users/e933bc34ab9c4f3899a028ce9de211ca/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:11.272600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1352d5-242d-4fae-bef7-e03844e8565a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:11.287695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1352d5-242d-4fae-bef7-e03844e8565a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:11.367168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f631f-a9e6-49cc-9dc4-e9ea3cc09679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:11.367815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f631f-a9e6-49cc-9dc4-e9ea3cc09679 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:11.368094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f631f-a9e6-49cc-9dc4-e9ea3cc09679 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:11.368392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f631f-a9e6-49cc-9dc4-e9ea3cc09679 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:11.369043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f631f-a9e6-49cc-9dc4-e9ea3cc09679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:11.370652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f631f-a9e6-49cc-9dc4-e9ea3cc09679 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:11.385315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 993/1981] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:11.389504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03735cc-48c5-4b9e-be4b-a981f5df0c6d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:11.404251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03735cc-48c5-4b9e-be4b-a981f5df0c6d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:11.409235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef7ce-7613-41cb-b2c0-523f4aa3bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:11.409980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef7ce-7613-41cb-b2c0-523f4aa3bc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:11.410261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef7ce-7613-41cb-b2c0-523f4aa3bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:11.410533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef7ce-7613-41cb-b2c0-523f4aa3bc17 admin admin] PATH_INFO: `/v3/projects/e082281818d545d584aab4f1739adc63/users/e933bc34ab9c4f3899a028ce9de211ca/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:11.413433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ef7ce-7613-41cb-b2c0-523f4aa3bc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e082281818d545d584aab4f1739adc63, user_id=e933bc34ab9c4f3899a028ce9de211ca, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:11.421539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ef7ce-7613-41cb-b2c0-523f4aa3bc17 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:11.427918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 989/1982] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:11 2022] PUT /identity/v3/projects/e082281818d545d584aab4f1739adc63/users/e933bc34ab9c4f3899a028ce9de211ca/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:11.438554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dbbe1-b442-436e-9253-a6719f426fa3 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:11.438835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dbbe1-b442-436e-9253-a6719f426fa3 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:11.439114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dbbe1-b442-436e-9253-a6719f426fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:11.505019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f38dbbe1-b442-436e-9253-a6719f426fa3 None None] MFA Rules not processed for user `e933bc34ab9c4f3899a028ce9de211ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:11.602779 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f38dbbe1-b442-436e-9253-a6719f426fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:11.636123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 994/1983] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:11.648856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef7ce-7613-41cb-b2c0-523f4aa3bc17 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:11.654754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f01ef7ce-7613-41cb-b2c0-523f4aa3bc17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:11.743508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef7ce-7613-41cb-b2c0-523f4aa3bc17 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:11.750350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27f359-7a5c-405b-8743-98101069adbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:11.751008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f359-7a5c-405b-8743-98101069adbc service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:11.751316 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f359-7a5c-405b-8743-98101069adbc service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:11.751590 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27f359-7a5c-405b-8743-98101069adbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:11.762672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27f359-7a5c-405b-8743-98101069adbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:11.767996 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27f359-7a5c-405b-8743-98101069adbc service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:11.788856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 990/1984] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:12.416137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dbb78-16bc-4a7f-9ab3-0a1947d25002 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:12.419905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dbb78-16bc-4a7f-9ab3-0a1947d25002 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:12.419905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dbb78-16bc-4a7f-9ab3-0a1947d25002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:12.484155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-970dbb78-16bc-4a7f-9ab3-0a1947d25002 None None] MFA Rules not processed for user `ee03387c96a04d5cbc9ec33a8a3b27af`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:12.485714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-970dbb78-16bc-4a7f-9ab3-0a1947d25002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:12.615081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 995/1985] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:12.626719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b71c8-284e-41c2-80aa-477125921572 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:12.627205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b71c8-284e-41c2-80aa-477125921572 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:12.627330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b71c8-284e-41c2-80aa-477125921572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:12.654051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-1e5b71c8-284e-41c2-80aa-477125921572 None None] MFA Rules not processed for user `7244451548bb4058bf9927a16b3af61b`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:12.659795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1e5b71c8-284e-41c2-80aa-477125921572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:12.791498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fda27-41ff-4428-93f8-53c218f4bd65 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:12.793593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fda27-41ff-4428-93f8-53c218f4bd65 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:12.794041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fda27-41ff-4428-93f8-53c218f4bd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:12.809880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 991/1986] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:12.817068 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b71c8-284e-41c2-80aa-477125921572 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:12.819480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1e5b71c8-284e-41c2-80aa-477125921572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:12.834515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-946fda27-41ff-4428-93f8-53c218f4bd65 None None] MFA Rules not processed for user `9984855ce18a4bf59e5eb91642ffc701`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:12.836293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-946fda27-41ff-4428-93f8-53c218f4bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:12.983602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:13.038656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b71c8-284e-41c2-80aa-477125921572 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:13.046715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c529d-1202-4d54-8f40-a61e1a4ec83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:13.047675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c529d-1202-4d54-8f40-a61e1a4ec83e service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:13.048340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c529d-1202-4d54-8f40-a61e1a4ec83e service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:13.048843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c529d-1202-4d54-8f40-a61e1a4ec83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:13.055929 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-081c529d-1202-4d54-8f40-a61e1a4ec83e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:13.068303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:13.076714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 996/1987] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:13.078393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fda27-41ff-4428-93f8-53c218f4bd65 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:13.080519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-946fda27-41ff-4428-93f8-53c218f4bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:13.088122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c529d-1202-4d54-8f40-a61e1a4ec83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:13.094688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c529d-1202-4d54-8f40-a61e1a4ec83e service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:13.128085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 992/1988] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:00:13.246959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fda27-41ff-4428-93f8-53c218f4bd65 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:13.253330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae306460-2a16-4414-ae78-bc9996505364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:13.254295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306460-2a16-4414-ae78-bc9996505364 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:13.255588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306460-2a16-4414-ae78-bc9996505364 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:13.256115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306460-2a16-4414-ae78-bc9996505364 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:13.257103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae306460-2a16-4414-ae78-bc9996505364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:13.259778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae306460-2a16-4414-ae78-bc9996505364 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:13.363520 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 997/1989] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:13 2022] POST /identity/v3/projects => generated 373 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:13.368299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c529d-1202-4d54-8f40-a61e1a4ec83e service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:13.385802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c529d-1202-4d54-8f40-a61e1a4ec83e service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:13.502393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4251e8-5f37-4bf4-967c-1a5e4e670171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:13.503081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4251e8-5f37-4bf4-967c-1a5e4e670171 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:13.503414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4251e8-5f37-4bf4-967c-1a5e4e670171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:13.503778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4251e8-5f37-4bf4-967c-1a5e4e670171 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:13.504851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4251e8-5f37-4bf4-967c-1a5e4e670171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:13.507194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4251e8-5f37-4bf4-967c-1a5e4e670171 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:13.616646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 993/1990] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:13 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:13.620204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae306460-2a16-4414-ae78-bc9996505364 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:13.634938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae306460-2a16-4414-ae78-bc9996505364 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:13.643329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028e17-a51a-4153-be04-64a8a904afa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:13.644021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028e17-a51a-4153-be04-64a8a904afa3 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:13.644307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028e17-a51a-4153-be04-64a8a904afa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:13.644732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52028e17-a51a-4153-be04-64a8a904afa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:13.645755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52028e17-a51a-4153-be04-64a8a904afa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:13.647752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52028e17-a51a-4153-be04-64a8a904afa3 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:13.665314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 998/1991] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:13.669131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4251e8-5f37-4bf4-967c-1a5e4e670171 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:13.681083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4251e8-5f37-4bf4-967c-1a5e4e670171 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:13.688985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c3c53-19da-423a-a07e-f5e0328d94ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:13.689978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c3c53-19da-423a-a07e-f5e0328d94ea admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:13.690404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c3c53-19da-423a-a07e-f5e0328d94ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:13.690839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c3c53-19da-423a-a07e-f5e0328d94ea admin admin] PATH_INFO: `/v3/projects/909ab90fbc40431c947b826f06de39b7/users/d30f8697368e419f93695d75d338068c/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:13.730057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c3c53-19da-423a-a07e-f5e0328d94ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=909ab90fbc40431c947b826f06de39b7, user_id=d30f8697368e419f93695d75d338068c, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:13.734151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c3c53-19da-423a-a07e-f5e0328d94ea admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:13.881530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 994/1992] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:13 2022] PUT /identity/v3/projects/909ab90fbc40431c947b826f06de39b7/users/d30f8697368e419f93695d75d338068c/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:13.894120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028e17-a51a-4153-be04-64a8a904afa3 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:13.898275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52028e17-a51a-4153-be04-64a8a904afa3 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:14.020681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0506fa7-05e2-4ed1-9ba2-9d7ac025da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:14.021529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0506fa7-05e2-4ed1-9ba2-9d7ac025da84 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:14.021952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0506fa7-05e2-4ed1-9ba2-9d7ac025da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:14.022280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0506fa7-05e2-4ed1-9ba2-9d7ac025da84 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:14.022941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0506fa7-05e2-4ed1-9ba2-9d7ac025da84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:14.025833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0506fa7-05e2-4ed1-9ba2-9d7ac025da84 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:14.058250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 999/1993] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:14.058392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c3c53-19da-423a-a07e-f5e0328d94ea admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:14.068657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c3c53-19da-423a-a07e-f5e0328d94ea admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:14.074444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45060-66b0-4887-9124-46e6dd3c1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:14.075710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45060-66b0-4887-9124-46e6dd3c1cff admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:14.076208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45060-66b0-4887-9124-46e6dd3c1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:14.076711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45060-66b0-4887-9124-46e6dd3c1cff admin admin] PATH_INFO: `/v3/projects/909ab90fbc40431c947b826f06de39b7/users/d30f8697368e419f93695d75d338068c/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:14.079725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b45060-66b0-4887-9124-46e6dd3c1cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=909ab90fbc40431c947b826f06de39b7, user_id=d30f8697368e419f93695d75d338068c, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:14.083736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b45060-66b0-4887-9124-46e6dd3c1cff admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:14.099758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 995/1994] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:14 2022] PUT /identity/v3/projects/909ab90fbc40431c947b826f06de39b7/users/d30f8697368e419f93695d75d338068c/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:14.766066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:14.828304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:16.215659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0506fa7-05e2-4ed1-9ba2-9d7ac025da84 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:16.246252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0506fa7-05e2-4ed1-9ba2-9d7ac025da84 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:16.435139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:16.435896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:16.436177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:16.436456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] PATH_INFO: `/v3/users/1aebca4cfa52410c8e1892441706c042` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:16.440585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aebca4cfa52410c8e1892441706c042)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:16.443342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:16.700628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:16.720460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aebca4cfa52410c8e1892441706c042'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:16.721637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aebca4cfa52410c8e1892441706c042'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:16.815918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:16.816183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aebca4cfa52410c8e1892441706c042'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:16.827597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aebca4cfa52410c8e1892441706c042'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:16.847765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aebca4cfa52410c8e1892441706c042'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:16.862231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1000/1995] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:16 2022] DELETE /identity/v3/users/1aebca4cfa52410c8e1892441706c042 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:16.867858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be102ab2-6548-4090-a2c8-1acd7d28d65b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:16.868393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be102ab2-6548-4090-a2c8-1acd7d28d65b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:16.868813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be102ab2-6548-4090-a2c8-1acd7d28d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:16.897553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-be102ab2-6548-4090-a2c8-1acd7d28d65b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:16.907638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-be102ab2-6548-4090-a2c8-1acd7d28d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:17.047336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 996/1996] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:17.055576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:17.062505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:17.187132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8e87d-5db8-4166-b71e-734645a0224d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:17.199587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba139bdc-804a-47a2-be10-149ff7382464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:17.199927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba139bdc-804a-47a2-be10-149ff7382464 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:17.200211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba139bdc-804a-47a2-be10-149ff7382464 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:17.200484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba139bdc-804a-47a2-be10-149ff7382464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:17.220326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba139bdc-804a-47a2-be10-149ff7382464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:17.223191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba139bdc-804a-47a2-be10-149ff7382464 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:17.246927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1001/1997] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:17.262443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:19.141461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be102ab2-6548-4090-a2c8-1acd7d28d65b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:19.143203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-be102ab2-6548-4090-a2c8-1acd7d28d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:19.199915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be102ab2-6548-4090-a2c8-1acd7d28d65b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:19.221754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:19.225892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:19.226177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:19.226456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] PATH_INFO: `/v3/projects/0f40b809f09040dd8a303685bdff2f2d` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:19.232057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f40b809f09040dd8a303685bdff2f2d)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:19.240648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:19.241471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba139bdc-804a-47a2-be10-149ff7382464 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:19.243912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ba139bdc-804a-47a2-be10-149ff7382464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:19.273501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba139bdc-804a-47a2-be10-149ff7382464 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:19.301380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:19.302490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:19.303418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:19.303932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] PATH_INFO: `/v3/users/5ad3f642f57941bf99c0c34125a5e4c2` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:19.307182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad3f642f57941bf99c0c34125a5e4c2)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:19.309880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:19.316344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:19.472658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f40b809f09040dd8a303685bdff2f2d', 'request_id': 'req-b9443c76-497d-41c4-92d9-1805dbecb3a0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.483713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f40b809f09040dd8a303685bdff2f2d', 'request_id': 'req-b9443c76-497d-41c4-92d9-1805dbecb3a0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.499457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f40b809f09040dd8a303685bdff2f2d', 'request_id': 'req-b9443c76-497d-41c4-92d9-1805dbecb3a0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.541601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:19.598385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] The token cache is being invalidate because project 0f40b809f09040dd8a303685bdff2f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:19.598385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.599998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.604654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 997/1998] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:19 2022] DELETE /identity/v3/projects/0f40b809f09040dd8a303685bdff2f2d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:19.608097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:19.609947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:19.651920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad3f642f57941bf99c0c34125a5e4c2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.652718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad3f642f57941bf99c0c34125a5e4c2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.736543 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad3f642f57941bf99c0c34125a5e4c2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.748968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad3f642f57941bf99c0c34125a5e4c2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.814630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ad1d12e1-7d4f-415d-a1be-ee5d132bd329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad3f642f57941bf99c0c34125a5e4c2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:19.825339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1002/1999] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:19 2022] DELETE /identity/v3/users/5ad3f642f57941bf99c0c34125a5e4c2 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:19.845559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1602c4-4e8f-4fc6-b465-6ff356638a73 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:19.847454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443c76-497d-41c4-92d9-1805dbecb3a0 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:19.847605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1602c4-4e8f-4fc6-b465-6ff356638a73 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:19.848061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1602c4-4e8f-4fc6-b465-6ff356638a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:19.902206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-5b1602c4-4e8f-4fc6-b465-6ff356638a73 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:19.904074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5b1602c4-4e8f-4fc6-b465-6ff356638a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:19.980038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:19.980551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:19.980829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:19.981101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] PATH_INFO: `/v3/users/e933bc34ab9c4f3899a028ce9de211ca` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:19.982952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e933bc34ab9c4f3899a028ce9de211ca)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:19.984776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:20.101359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1003/2000] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:20.148274 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1602c4-4e8f-4fc6-b465-6ff356638a73 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:20.150503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5b1602c4-4e8f-4fc6-b465-6ff356638a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:20.246690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e933bc34ab9c4f3899a028ce9de211ca'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:20.247575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e933bc34ab9c4f3899a028ce9de211ca'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:20.265594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e933bc34ab9c4f3899a028ce9de211ca'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:20.278907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1602c4-4e8f-4fc6-b465-6ff356638a73 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:20.284092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:20.284861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:20.285203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:20.285537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:20.288296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:20.309338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:20.316174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:20.329971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1004/2001] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:00:20.377492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e933bc34ab9c4f3899a028ce9de211ca'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:20.402241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed882751-9944-4d07-9bfd-e4be206f94d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e933bc34ab9c4f3899a028ce9de211ca'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:20.416183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 998/2002] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:19 2022] DELETE /identity/v3/users/e933bc34ab9c4f3899a028ce9de211ca => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:20.987536 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:21.529172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:21.541989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:21.543868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:21.562169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30ec74-d09b-4196-b1aa-ea6c6e4142d8 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:21.647330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:21.648705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:21.649234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:21.650374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] PATH_INFO: `/v3/projects/520ae6dbea00410f823d425afca33486` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:21.652690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=520ae6dbea00410f823d425afca33486)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:21.655044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:21.797430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520ae6dbea00410f823d425afca33486', 'request_id': 'req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:21.804781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520ae6dbea00410f823d425afca33486', 'request_id': 'req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:21.889102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520ae6dbea00410f823d425afca33486', 'request_id': 'req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:21.908298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] The token cache is being invalidate because project 520ae6dbea00410f823d425afca33486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:21.908834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:21.918699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5f4fe2a2-4311-4f85-80aa-1e6bd4482e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:21.921011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1005/2003] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:21 2022] DELETE /identity/v3/projects/520ae6dbea00410f823d425afca33486 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:21.930444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e131bb4-65b3-4465-bbbf-0b1919e623ed None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:21.931257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e131bb4-65b3-4465-bbbf-0b1919e623ed None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:21.931955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e131bb4-65b3-4465-bbbf-0b1919e623ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:21.976576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0e131bb4-65b3-4465-bbbf-0b1919e623ed None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:21.978549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0e131bb4-65b3-4465-bbbf-0b1919e623ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:22.066975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 999/2004] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:22.074783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6df1-194e-4810-aa48-ca641227026b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:22.075709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6df1-194e-4810-aa48-ca641227026b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:22.076172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b6df1-194e-4810-aa48-ca641227026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:22.123494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7e1b6df1-194e-4810-aa48-ca641227026b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:22.127212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7e1b6df1-194e-4810-aa48-ca641227026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:22.149165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1006/2005] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:22.153795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e131bb4-65b3-4465-bbbf-0b1919e623ed None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:22.174471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e131bb4-65b3-4465-bbbf-0b1919e623ed None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:22.189244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200809e-9a79-432e-9996-19169c409eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:22.190107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200809e-9a79-432e-9996-19169c409eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:22.190868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200809e-9a79-432e-9996-19169c409eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:22.191458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200809e-9a79-432e-9996-19169c409eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:22.193323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200809e-9a79-432e-9996-19169c409eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:22.194273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200809e-9a79-432e-9996-19169c409eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:22.195874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6df1-194e-4810-aa48-ca641227026b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:22.197955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7e1b6df1-194e-4810-aa48-ca641227026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:22.218630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200809e-9a79-432e-9996-19169c409eb2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:22.230847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b6df1-194e-4810-aa48-ca641227026b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:22.274992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:22.275687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:22.275964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:22.276239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] PATH_INFO: `/v3/projects/e082281818d545d584aab4f1739adc63` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:22.277659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e082281818d545d584aab4f1739adc63)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:22.281408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1000/2006] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:22.290253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:22.292930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200809e-9a79-432e-9996-19169c409eb2 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:22.324160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200809e-9a79-432e-9996-19169c409eb2 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:22.342189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96eeed-f765-4f64-849b-be5aefc9dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:22.342818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96eeed-f765-4f64-849b-be5aefc9dce9 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:22.343099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96eeed-f765-4f64-849b-be5aefc9dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:22.343399 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96eeed-f765-4f64-849b-be5aefc9dce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:22.344051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96eeed-f765-4f64-849b-be5aefc9dce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:22.346030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96eeed-f765-4f64-849b-be5aefc9dce9 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:22.462996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e082281818d545d584aab4f1739adc63', 'request_id': 'req-c039d919-2283-4309-92f8-2a9551da6f14'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:22.473587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e082281818d545d584aab4f1739adc63', 'request_id': 'req-c039d919-2283-4309-92f8-2a9551da6f14'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:22.538902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1001/2007] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:22 2022] POST /identity/v3/projects => generated 383 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:22.540928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96eeed-f765-4f64-849b-be5aefc9dce9 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:22.555015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e082281818d545d584aab4f1739adc63', 'request_id': 'req-c039d919-2283-4309-92f8-2a9551da6f14'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:22.595096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] The token cache is being invalidate because project e082281818d545d584aab4f1739adc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:22.595455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:22.598080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c039d919-2283-4309-92f8-2a9551da6f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:22.611739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1007/2008] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:22 2022] DELETE /identity/v3/projects/e082281818d545d584aab4f1739adc63 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:22.618384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c441c-532d-49fa-898a-636f22b3ad49 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:22.619983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c441c-532d-49fa-898a-636f22b3ad49 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:22.620510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c441c-532d-49fa-898a-636f22b3ad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:22.678769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96eeed-f765-4f64-849b-be5aefc9dce9 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:22.694601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9222f8-59fa-4237-b05e-16554f4666da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:22.694601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9222f8-59fa-4237-b05e-16554f4666da admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:22.694601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9222f8-59fa-4237-b05e-16554f4666da admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:22.694601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9222f8-59fa-4237-b05e-16554f4666da admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:22.696612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9222f8-59fa-4237-b05e-16554f4666da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:22.702049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9222f8-59fa-4237-b05e-16554f4666da admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:22.702243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d08c441c-532d-49fa-898a-636f22b3ad49 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:22.706848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d08c441c-532d-49fa-898a-636f22b3ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:22.717620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:22.737749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1008/2009] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:22.748564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eba552-e4b3-4c47-8639-931a297efdf7 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:22.749055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eba552-e4b3-4c47-8639-931a297efdf7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:22.751801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eba552-e4b3-4c47-8639-931a297efdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:22.802842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e6eba552-e4b3-4c47-8639-931a297efdf7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:22.807598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e6eba552-e4b3-4c47-8639-931a297efdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:22.832436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1009/2010] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:22.837277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eba552-e4b3-4c47-8639-931a297efdf7 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:22.850479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1002/2011] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:22 2022] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:22.854045 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9222f8-59fa-4237-b05e-16554f4666da admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:22.857932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3a9222f8-59fa-4237-b05e-16554f4666da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:22.868952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eba552-e4b3-4c47-8639-931a297efdf7 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:22.911186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9222f8-59fa-4237-b05e-16554f4666da admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:22.916770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c1ab0-92e2-475d-8a9b-63694ec96394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:22.917513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c1ab0-92e2-475d-8a9b-63694ec96394 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:22.917672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c1ab0-92e2-475d-8a9b-63694ec96394 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:22.917947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c1ab0-92e2-475d-8a9b-63694ec96394 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:22.919193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c1ab0-92e2-475d-8a9b-63694ec96394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:22.919532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c1ab0-92e2-475d-8a9b-63694ec96394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:22.923001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c1ab0-92e2-475d-8a9b-63694ec96394 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:22.923908 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fe00e-f70e-47ed-b9cc-d11fa16cd42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:22.929396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fe00e-f70e-47ed-b9cc-d11fa16cd42a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:22.929396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fe00e-f70e-47ed-b9cc-d11fa16cd42a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:22.929396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fe00e-f70e-47ed-b9cc-d11fa16cd42a admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:22.929762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fe00e-f70e-47ed-b9cc-d11fa16cd42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:22.933822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fe00e-f70e-47ed-b9cc-d11fa16cd42a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:22.959800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1010/2012] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:22.962646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c1ab0-92e2-475d-8a9b-63694ec96394 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:22.976243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1003/2013] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:22.982480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fe00e-f70e-47ed-b9cc-d11fa16cd42a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:22.988828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c1ab0-92e2-475d-8a9b-63694ec96394 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:23.007355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafbf50-03dd-479e-a100-0f34a054622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:23.007571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fe00e-f70e-47ed-b9cc-d11fa16cd42a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:23.008558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafbf50-03dd-479e-a100-0f34a054622f admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.009120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafbf50-03dd-479e-a100-0f34a054622f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.009687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafbf50-03dd-479e-a100-0f34a054622f admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.011727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafbf50-03dd-479e-a100-0f34a054622f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:23.014739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafbf50-03dd-479e-a100-0f34a054622f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:23.015300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a91ba-1c20-4132-8043-9248034a1bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:23.016108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a91ba-1c20-4132-8043-9248034a1bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.016549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a91ba-1c20-4132-8043-9248034a1bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.016967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a91ba-1c20-4132-8043-9248034a1bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.017815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a91ba-1c20-4132-8043-9248034a1bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:23.019641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a91ba-1c20-4132-8043-9248034a1bf7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:23.047124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1004/2014] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:23.051337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a91ba-1c20-4132-8043-9248034a1bf7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:23.064158 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a91ba-1c20-4132-8043-9248034a1bf7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:23.070433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558be41-2ea3-4024-9414-a4ec080dcab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:23.071112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558be41-2ea3-4024-9414-a4ec080dcab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.071443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558be41-2ea3-4024-9414-a4ec080dcab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.071778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558be41-2ea3-4024-9414-a4ec080dcab1 admin admin] PATH_INFO: `/v3/projects/4ed9f607e7434f42b2c1158c3cafae21/users/1c752aa30d1c4a088fb5e2bb8ad090a0/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.099491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558be41-2ea3-4024-9414-a4ec080dcab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed9f607e7434f42b2c1158c3cafae21, user_id=1c752aa30d1c4a088fb5e2bb8ad090a0, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:23.103101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558be41-2ea3-4024-9414-a4ec080dcab1 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:23.106698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:23.118666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1011/2015] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:22 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:23.122969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafbf50-03dd-479e-a100-0f34a054622f admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:23.222442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafbf50-03dd-479e-a100-0f34a054622f admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:23.223938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1005/2016] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:23 2022] PUT /identity/v3/projects/4ed9f607e7434f42b2c1158c3cafae21/users/1c752aa30d1c4a088fb5e2bb8ad090a0/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:23.236183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2fbc-61e9-4886-95e7-f58e5574a010 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.238822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2fbc-61e9-4886-95e7-f58e5574a010 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.239907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2fbc-61e9-4886-95e7-f58e5574a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.306000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-846c2fbc-61e9-4886-95e7-f58e5574a010 None None] MFA Rules not processed for user `1c752aa30d1c4a088fb5e2bb8ad090a0`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:23.307613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-846c2fbc-61e9-4886-95e7-f58e5574a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:23.374447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc948e5-b0ff-49d5-a249-7f25984886b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:23.375255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc948e5-b0ff-49d5-a249-7f25984886b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.377337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc948e5-b0ff-49d5-a249-7f25984886b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.377756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc948e5-b0ff-49d5-a249-7f25984886b7 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.378562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc948e5-b0ff-49d5-a249-7f25984886b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:23.383127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc948e5-b0ff-49d5-a249-7f25984886b7 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:23.493911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1006/2017] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:23.504632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1012/2018] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:23 2022] POST /identity/v3/users => generated 292 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:23.508519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2fbc-61e9-4886-95e7-f58e5574a010 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:23.513037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc948e5-b0ff-49d5-a249-7f25984886b7 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:23.513184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-846c2fbc-61e9-4886-95e7-f58e5574a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:23.533797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc948e5-b0ff-49d5-a249-7f25984886b7 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:23.542187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31240b3a-f028-4271-a94a-d0630c87bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:23.542790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31240b3a-f028-4271-a94a-d0630c87bfda admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.543365 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31240b3a-f028-4271-a94a-d0630c87bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.543660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31240b3a-f028-4271-a94a-d0630c87bfda admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.544341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31240b3a-f028-4271-a94a-d0630c87bfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:23.545998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31240b3a-f028-4271-a94a-d0630c87bfda admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:23.565108 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1013/2019] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:23.572372 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31240b3a-f028-4271-a94a-d0630c87bfda admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:23.601115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31240b3a-f028-4271-a94a-d0630c87bfda admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:23.605450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2fbc-61e9-4886-95e7-f58e5574a010 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:23.612365 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c4f68-c870-4e70-9a98-6189c439d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:23.613469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c4f68-c870-4e70-9a98-6189c439d3eb admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.614619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c4f68-c870-4e70-9a98-6189c439d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.615117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c4f68-c870-4e70-9a98-6189c439d3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.616315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c4f68-c870-4e70-9a98-6189c439d3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:23.618191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c4f68-c870-4e70-9a98-6189c439d3eb admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:23.620966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0156b3-0877-4837-a023-dd3700aada27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:23.622577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0156b3-0877-4837-a023-dd3700aada27 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.622778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0156b3-0877-4837-a023-dd3700aada27 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.623970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0156b3-0877-4837-a023-dd3700aada27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.639667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1014/2020] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:23.643766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c4f68-c870-4e70-9a98-6189c439d3eb admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:23.651105 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0156b3-0877-4837-a023-dd3700aada27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:23.652884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0156b3-0877-4837-a023-dd3700aada27 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:23.657671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c4f68-c870-4e70-9a98-6189c439d3eb admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:23.664272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73734b00-63be-4166-9a07-ed2bae58dae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:23.665053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73734b00-63be-4166-9a07-ed2bae58dae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.665566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73734b00-63be-4166-9a07-ed2bae58dae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.666049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73734b00-63be-4166-9a07-ed2bae58dae3 admin admin] PATH_INFO: `/v3/projects/c53977a7abaf49098a3d9ed253025278/users/cab65fe0b88d479e9a78f7abd1620933/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.675049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1007/2021] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:23.706601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73734b00-63be-4166-9a07-ed2bae58dae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53977a7abaf49098a3d9ed253025278, user_id=cab65fe0b88d479e9a78f7abd1620933, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:23.714265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73734b00-63be-4166-9a07-ed2bae58dae3 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:23.847487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1015/2022] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:23 2022] PUT /identity/v3/projects/c53977a7abaf49098a3d9ed253025278/users/cab65fe0b88d479e9a78f7abd1620933/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:23.862359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9e985-a299-4e85-854b-f0a3709c99b1 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:23.862891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9e985-a299-4e85-854b-f0a3709c99b1 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:23.863218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9e985-a299-4e85-854b-f0a3709c99b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:23.914522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-eaf9e985-a299-4e85-854b-f0a3709c99b1 None None] MFA Rules not processed for user `cab65fe0b88d479e9a78f7abd1620933`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:23.919775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-eaf9e985-a299-4e85-854b-f0a3709c99b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:24.012744 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:24.033651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73734b00-63be-4166-9a07-ed2bae58dae3 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:24.035004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1008/2023] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:24.150691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73734b00-63be-4166-9a07-ed2bae58dae3 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:24.155598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f2cb1-25d5-4d08-8d50-2de8049ec8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:24.156236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f2cb1-25d5-4d08-8d50-2de8049ec8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:24.156496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f2cb1-25d5-4d08-8d50-2de8049ec8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:24.156929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f2cb1-25d5-4d08-8d50-2de8049ec8d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:24.157567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f2cb1-25d5-4d08-8d50-2de8049ec8d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:24.161426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f2cb1-25d5-4d08-8d50-2de8049ec8d8 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:24.243864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1016/2024] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:24 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:24.247423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9e985-a299-4e85-854b-f0a3709c99b1 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:24.277738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9e985-a299-4e85-854b-f0a3709c99b1 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:24.383790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1532ea-d7dc-4f13-86a0-d177a937f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:24.384671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1532ea-d7dc-4f13-86a0-d177a937f666 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:24.384956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1532ea-d7dc-4f13-86a0-d177a937f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:24.385227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1532ea-d7dc-4f13-86a0-d177a937f666 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:24.385887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1532ea-d7dc-4f13-86a0-d177a937f666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:24.388029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1532ea-d7dc-4f13-86a0-d177a937f666 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:24.518877 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1009/2025] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:24 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:24.520478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f2cb1-25d5-4d08-8d50-2de8049ec8d8 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:24.534967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f2cb1-25d5-4d08-8d50-2de8049ec8d8 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:24.548295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205c21-ed1a-41b1-9b7c-0f543e4223f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:24.549547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205c21-ed1a-41b1-9b7c-0f543e4223f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:24.550032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205c21-ed1a-41b1-9b7c-0f543e4223f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:24.552982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10205c21-ed1a-41b1-9b7c-0f543e4223f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:24.588852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10205c21-ed1a-41b1-9b7c-0f543e4223f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:24.588852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10205c21-ed1a-41b1-9b7c-0f543e4223f5 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:24.595081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1017/2026] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:24.597168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1532ea-d7dc-4f13-86a0-d177a937f666 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:24.613726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1532ea-d7dc-4f13-86a0-d177a937f666 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:24.627810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748ce8-a38d-42c9-9866-947ab0731291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:24.627810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748ce8-a38d-42c9-9866-947ab0731291 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:24.627810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748ce8-a38d-42c9-9866-947ab0731291 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:24.627810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748ce8-a38d-42c9-9866-947ab0731291 admin admin] PATH_INFO: `/v3/projects/ba94dfc86c544a0b8382095229f85004/users/e5c2774401c04bd9b049b3193f82a775/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:24.668374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748ce8-a38d-42c9-9866-947ab0731291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba94dfc86c544a0b8382095229f85004, user_id=e5c2774401c04bd9b049b3193f82a775, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:24.673231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748ce8-a38d-42c9-9866-947ab0731291 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:24.750380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1010/2027] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:24 2022] PUT /identity/v3/projects/ba94dfc86c544a0b8382095229f85004/users/e5c2774401c04bd9b049b3193f82a775/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:24.754384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205c21-ed1a-41b1-9b7c-0f543e4223f5 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:24.771646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10205c21-ed1a-41b1-9b7c-0f543e4223f5 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:24.872211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6a22b-97d7-48be-94ff-9766fe6ed825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:24.873052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6a22b-97d7-48be-94ff-9766fe6ed825 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:24.877124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6a22b-97d7-48be-94ff-9766fe6ed825 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:24.877656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6a22b-97d7-48be-94ff-9766fe6ed825 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:24.878576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6a22b-97d7-48be-94ff-9766fe6ed825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:24.881216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6a22b-97d7-48be-94ff-9766fe6ed825 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:24.898492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1018/2028] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:24.902460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748ce8-a38d-42c9-9866-947ab0731291 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:24.916779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748ce8-a38d-42c9-9866-947ab0731291 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:24.937869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:24.939133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bff31d-41f5-4f0c-a566-6cfebfa8f5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:24.940582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bff31d-41f5-4f0c-a566-6cfebfa8f5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:24.944711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bff31d-41f5-4f0c-a566-6cfebfa8f5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:24.944711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bff31d-41f5-4f0c-a566-6cfebfa8f5f7 admin admin] PATH_INFO: `/v3/projects/ba94dfc86c544a0b8382095229f85004/users/e5c2774401c04bd9b049b3193f82a775/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:24.944711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bff31d-41f5-4f0c-a566-6cfebfa8f5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba94dfc86c544a0b8382095229f85004, user_id=e5c2774401c04bd9b049b3193f82a775, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:24.947856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bff31d-41f5-4f0c-a566-6cfebfa8f5f7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:24.962122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1011/2029] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:24 2022] PUT /identity/v3/projects/ba94dfc86c544a0b8382095229f85004/users/e5c2774401c04bd9b049b3193f82a775/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:24.973241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5697a-077e-4e90-8421-448e3d10837c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:24.974554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5697a-077e-4e90-8421-448e3d10837c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:24.974988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5697a-077e-4e90-8421-448e3d10837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:25.013526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3fd5697a-077e-4e90-8421-448e3d10837c None None] MFA Rules not processed for user `e5c2774401c04bd9b049b3193f82a775`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:25.015405 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3fd5697a-077e-4e90-8421-448e3d10837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:25.140183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1019/2030] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:25.150491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bff31d-41f5-4f0c-a566-6cfebfa8f5f7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:25.243340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bff31d-41f5-4f0c-a566-6cfebfa8f5f7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:25.249644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822421e9-c41e-47a5-9adb-4b5f8e2f686c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:25.250859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822421e9-c41e-47a5-9adb-4b5f8e2f686c service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:25.251146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822421e9-c41e-47a5-9adb-4b5f8e2f686c service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:25.251480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822421e9-c41e-47a5-9adb-4b5f8e2f686c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:25.267448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822421e9-c41e-47a5-9adb-4b5f8e2f686c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:25.269819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822421e9-c41e-47a5-9adb-4b5f8e2f686c service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:25.288439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1012/2031] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:25.337338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5697a-077e-4e90-8421-448e3d10837c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:25.448989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5697a-077e-4e90-8421-448e3d10837c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:25.454976 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:25.456630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:25.456630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:25.456630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] PATH_INFO: `/v3/users/cab65fe0b88d479e9a78f7abd1620933` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:25.458607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab65fe0b88d479e9a78f7abd1620933)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:25.461134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:25.603979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb1293-e553-4f5c-b4f9-293f027aca09 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:25.603979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb1293-e553-4f5c-b4f9-293f027aca09 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:25.603979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb1293-e553-4f5c-b4f9-293f027aca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:25.637184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ccdb1293-e553-4f5c-b4f9-293f027aca09 None None] MFA Rules not processed for user `d30f8697368e419f93695d75d338068c`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:25.638409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ccdb1293-e553-4f5c-b4f9-293f027aca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:25.721943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1013/2032] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:25.729639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab65fe0b88d479e9a78f7abd1620933'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:25.730325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab65fe0b88d479e9a78f7abd1620933'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:25.737872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb1293-e553-4f5c-b4f9-293f027aca09 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:25.740280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ccdb1293-e553-4f5c-b4f9-293f027aca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:25.804039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab65fe0b88d479e9a78f7abd1620933'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:25.812408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab65fe0b88d479e9a78f7abd1620933'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:25.826808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-80d00f53-92c1-42b4-aba4-c9217dccf69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab65fe0b88d479e9a78f7abd1620933'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:25.834247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1020/2033] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:25 2022] DELETE /identity/v3/users/cab65fe0b88d479e9a78f7abd1620933 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:25.838813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7592a-440b-4b2f-8592-4252e5be14cb None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:25.839693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7592a-440b-4b2f-8592-4252e5be14cb None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:25.840191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7592a-440b-4b2f-8592-4252e5be14cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:25.863005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb1293-e553-4f5c-b4f9-293f027aca09 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:25.866666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-07b7592a-440b-4b2f-8592-4252e5be14cb None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:25.869186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-07b7592a-440b-4b2f-8592-4252e5be14cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:25.892210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:25.961249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1021/2034] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:25.972417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7592a-440b-4b2f-8592-4252e5be14cb None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:25.976000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:25.977809 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-07b7592a-440b-4b2f-8592-4252e5be14cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:26.032118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:26.033570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:26.034022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:26.034456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:26.037192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:26.137116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7592a-440b-4b2f-8592-4252e5be14cb None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:26.139298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:26.141228 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:26.146312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581651f-0f06-454b-a1bb-14e3ca9de6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:26.147138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581651f-0f06-454b-a1bb-14e3ca9de6aa service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:26.155049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581651f-0f06-454b-a1bb-14e3ca9de6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:26.155049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581651f-0f06-454b-a1bb-14e3ca9de6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:26.155518 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1014/2035] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:26.169890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581651f-0f06-454b-a1bb-14e3ca9de6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:26.171540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581651f-0f06-454b-a1bb-14e3ca9de6aa service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:26.209829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1022/2036] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:27.238155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:27.240992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:27.272328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb5756-43d4-4f44-863c-3db111d172b6 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:27.288874 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:27.289975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:27.291404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:27.291846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] PATH_INFO: `/v3/users/1c752aa30d1c4a088fb5e2bb8ad090a0` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:27.300168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c752aa30d1c4a088fb5e2bb8ad090a0)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:27.302259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:27.343184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581651f-0f06-454b-a1bb-14e3ca9de6aa service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:27.344748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2581651f-0f06-454b-a1bb-14e3ca9de6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:27.369466 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581651f-0f06-454b-a1bb-14e3ca9de6aa service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:27.383505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:27.384947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:27.385395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:27.385819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] PATH_INFO: `/v3/projects/c53977a7abaf49098a3d9ed253025278` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:27.387610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53977a7abaf49098a3d9ed253025278)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:27.390821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:27.416328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:27.525247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c752aa30d1c4a088fb5e2bb8ad090a0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.526234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c752aa30d1c4a088fb5e2bb8ad090a0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.552692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c752aa30d1c4a088fb5e2bb8ad090a0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.597739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53977a7abaf49098a3d9ed253025278', 'request_id': 'req-2702ded0-6f86-406d-80c0-121e34912189'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.626997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53977a7abaf49098a3d9ed253025278', 'request_id': 'req-2702ded0-6f86-406d-80c0-121e34912189'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.658766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c752aa30d1c4a088fb5e2bb8ad090a0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.710431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a30526b2-5ead-4d30-8c27-9f734d4a1c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c752aa30d1c4a088fb5e2bb8ad090a0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.732661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1015/2037] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:27 2022] DELETE /identity/v3/users/1c752aa30d1c4a088fb5e2bb8ad090a0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:27.737475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a7df-e391-4188-8bf0-6e1a5e32e77f None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:27.737849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a7df-e391-4188-8bf0-6e1a5e32e77f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:27.738553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a7df-e391-4188-8bf0-6e1a5e32e77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:27.742066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53977a7abaf49098a3d9ed253025278', 'request_id': 'req-2702ded0-6f86-406d-80c0-121e34912189'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.759494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] The token cache is being invalidate because project c53977a7abaf49098a3d9ed253025278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:27.760097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.762106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:27.768478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1023/2038] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:27 2022] DELETE /identity/v3/projects/c53977a7abaf49098a3d9ed253025278 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:27.769791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:27.772339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:27.789561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8256a7df-e391-4188-8bf0-6e1a5e32e77f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:27.791704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8256a7df-e391-4188-8bf0-6e1a5e32e77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:27.906373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1016/2039] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:27.914397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a7df-e391-4188-8bf0-6e1a5e32e77f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:27.916502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8256a7df-e391-4188-8bf0-6e1a5e32e77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:27.926592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:27.953798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702ded0-6f86-406d-80c0-121e34912189 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:27.967968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:27.968827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:27.969323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:27.969646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] PATH_INFO: `/v3/users/e5c2774401c04bd9b049b3193f82a775` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:27.972540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c2774401c04bd9b049b3193f82a775)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:27.978194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:27.981046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:28.100094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a7df-e391-4188-8bf0-6e1a5e32e77f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:28.112824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3373c5f-1b94-4296-a559-89f8c2edbbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:28.113970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3373c5f-1b94-4296-a559-89f8c2edbbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:28.114247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3373c5f-1b94-4296-a559-89f8c2edbbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:28.114524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3373c5f-1b94-4296-a559-89f8c2edbbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:28.129069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3373c5f-1b94-4296-a559-89f8c2edbbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:28.132391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3373c5f-1b94-4296-a559-89f8c2edbbc6 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:28.155454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1017/2040] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:00:28.250421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c2774401c04bd9b049b3193f82a775'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:28.251135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c2774401c04bd9b049b3193f82a775'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:28.326033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c2774401c04bd9b049b3193f82a775'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:28.337281 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c2774401c04bd9b049b3193f82a775'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:28.364954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-35274ec1-e298-4b70-ad16-ecfdf0fe3421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c2774401c04bd9b049b3193f82a775'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:28.378501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1024/2041] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:27 2022] DELETE /identity/v3/users/e5c2774401c04bd9b049b3193f82a775 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:28.906244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3373c5f-1b94-4296-a559-89f8c2edbbc6 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:28.906244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e3373c5f-1b94-4296-a559-89f8c2edbbc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:28.941252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3373c5f-1b94-4296-a559-89f8c2edbbc6 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:29.080030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:29.080971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:29.081304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:29.081679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] PATH_INFO: `/v3/projects/4ed9f607e7434f42b2c1158c3cafae21` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:29.083991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed9f607e7434f42b2c1158c3cafae21)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:29.086225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:29.297263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed9f607e7434f42b2c1158c3cafae21', 'request_id': 'req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:29.324495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed9f607e7434f42b2c1158c3cafae21', 'request_id': 'req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:29.333963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed9f607e7434f42b2c1158c3cafae21', 'request_id': 'req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:29.439452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] The token cache is being invalidate because project 4ed9f607e7434f42b2c1158c3cafae21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:29.440080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:29.441994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:29.448956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1018/2042] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:28 2022] DELETE /identity/v3/projects/4ed9f607e7434f42b2c1158c3cafae21 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:29.450037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167da0d-b829-4396-9c2d-faf76fd3e8a1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:29.450474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167da0d-b829-4396-9c2d-faf76fd3e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:29.450819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167da0d-b829-4396-9c2d-faf76fd3e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:29.481149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:29.484798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:29.496308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6167da0d-b829-4396-9c2d-faf76fd3e8a1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:29.498696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6167da0d-b829-4396-9c2d-faf76fd3e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:29.620385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:29.670111 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1025/2043] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:29.677250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:29.681339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83232b0-cd66-41c9-ab64-869e9d48252f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:29.681934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83232b0-cd66-41c9-ab64-869e9d48252f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:29.682444 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83232b0-cd66-41c9-ab64-869e9d48252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:29.709232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b5fda-1d53-46c4-97aa-fdc322bc3a69 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:29.714814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:29.716758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:29.717031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:29.717678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] PATH_INFO: `/v3/projects/ba94dfc86c544a0b8382095229f85004` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:29.719497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba94dfc86c544a0b8382095229f85004)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:29.722026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:29.739461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c83232b0-cd66-41c9-ab64-869e9d48252f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:29.741658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c83232b0-cd66-41c9-ab64-869e9d48252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:29.778259 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1026/2044] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:29.784510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83232b0-cd66-41c9-ab64-869e9d48252f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:29.815971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83232b0-cd66-41c9-ab64-869e9d48252f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:29.825692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765e791-a8b5-45dc-8dd6-f3344362541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:29.826335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e791-a8b5-45dc-8dd6-f3344362541c admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:29.826612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e791-a8b5-45dc-8dd6-f3344362541c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:29.826878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e791-a8b5-45dc-8dd6-f3344362541c admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:29.828076 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765e791-a8b5-45dc-8dd6-f3344362541c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:29.829263 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765e791-a8b5-45dc-8dd6-f3344362541c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:29.831276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765e791-a8b5-45dc-8dd6-f3344362541c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:29.857178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1027/2045] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:29.858244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765e791-a8b5-45dc-8dd6-f3344362541c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:29.894596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765e791-a8b5-45dc-8dd6-f3344362541c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:29.922272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba94dfc86c544a0b8382095229f85004', 'request_id': 'req-72a95c8c-db61-452e-83f4-1fb4457978c8'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:29.956862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba94dfc86c544a0b8382095229f85004', 'request_id': 'req-72a95c8c-db61-452e-83f4-1fb4457978c8'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:29.978750 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba94dfc86c544a0b8382095229f85004', 'request_id': 'req-72a95c8c-db61-452e-83f4-1fb4457978c8'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:30.068823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] The token cache is being invalidate because project ba94dfc86c544a0b8382095229f85004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:30.069292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:30.072488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-72a95c8c-db61-452e-83f4-1fb4457978c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:30.078505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1019/2046] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:29 2022] DELETE /identity/v3/projects/ba94dfc86c544a0b8382095229f85004 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:30.080090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbaa7b-96ec-4dbc-a743-491223bcce76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:30.081347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbaa7b-96ec-4dbc-a743-491223bcce76 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.085012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbaa7b-96ec-4dbc-a743-491223bcce76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.088728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464901-3c7a-466f-86c2-d0822985d45e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.090018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbaa7b-96ec-4dbc-a743-491223bcce76 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.090429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbaa7b-96ec-4dbc-a743-491223bcce76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:30.099696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464901-3c7a-466f-86c2-d0822985d45e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.100389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464901-3c7a-466f-86c2-d0822985d45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.104216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbaa7b-96ec-4dbc-a743-491223bcce76 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:30.151960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-de464901-3c7a-466f-86c2-d0822985d45e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:30.153551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-de464901-3c7a-466f-86c2-d0822985d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:30.162780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1020/2047] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:30.171986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da9997-e9f4-4f71-a031-6e3ea9ef6cd2 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.172698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da9997-e9f4-4f71-a031-6e3ea9ef6cd2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.173129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da9997-e9f4-4f71-a031-6e3ea9ef6cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.198545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-31da9997-e9f4-4f71-a031-6e3ea9ef6cd2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:30.200554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-31da9997-e9f4-4f71-a031-6e3ea9ef6cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:30.212274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1021/2048] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:30.216782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da9997-e9f4-4f71-a031-6e3ea9ef6cd2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:30.231493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da9997-e9f4-4f71-a031-6e3ea9ef6cd2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:30.237952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ea9f9-2f07-4ced-87fc-9c842320d320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:30.238911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ea9f9-2f07-4ced-87fc-9c842320d320 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.240081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ea9f9-2f07-4ced-87fc-9c842320d320 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.240766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ea9f9-2f07-4ced-87fc-9c842320d320 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.241652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ea9f9-2f07-4ced-87fc-9c842320d320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:30.242129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ea9f9-2f07-4ced-87fc-9c842320d320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:30.244434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ea9f9-2f07-4ced-87fc-9c842320d320 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:30.267000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1028/2049] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:29 2022] POST /identity/v3/projects => generated 365 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:30.268690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbaa7b-96ec-4dbc-a743-491223bcce76 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:30.276454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-45dbaa7b-96ec-4dbc-a743-491223bcce76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:30.293287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1022/2050] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:30.298259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ea9f9-2f07-4ced-87fc-9c842320d320 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:30.328925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ea9f9-2f07-4ced-87fc-9c842320d320 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:30.401257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbaa7b-96ec-4dbc-a743-491223bcce76 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:30.409560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20f8d3-fbca-4901-a8db-c66ad6a84773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:30.414128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f8d3-fbca-4901-a8db-c66ad6a84773 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.414639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f8d3-fbca-4901-a8db-c66ad6a84773 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.415398 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f8d3-fbca-4901-a8db-c66ad6a84773 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.420849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20f8d3-fbca-4901-a8db-c66ad6a84773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:30.420849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20f8d3-fbca-4901-a8db-c66ad6a84773 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:30.501295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549fadb-8e60-4420-a930-c14780ba63b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:30.506688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549fadb-8e60-4420-a930-c14780ba63b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.506688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549fadb-8e60-4420-a930-c14780ba63b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.506688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549fadb-8e60-4420-a930-c14780ba63b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.506688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549fadb-8e60-4420-a930-c14780ba63b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:30.506688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549fadb-8e60-4420-a930-c14780ba63b6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:30.553691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1029/2051] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:30 2022] POST /identity/v3/users => generated 283 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:30.556365 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f423-1439-4e64-829a-495289220983 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.558097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f423-1439-4e64-829a-495289220983 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.558097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4f423-1439-4e64-829a-495289220983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.593166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-61a4f423-1439-4e64-829a-495289220983 None None] MFA Rules not processed for user `9984855ce18a4bf59e5eb91642ffc701`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:30.593531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-61a4f423-1439-4e64-829a-495289220983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:30.659133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1023/2052] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:30 2022] POST /identity/v3/projects => generated 377 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:30.660215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549fadb-8e60-4420-a930-c14780ba63b6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:30.714595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1030/2053] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:30.717029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4f423-1439-4e64-829a-495289220983 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:30.737201 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4f423-1439-4e64-829a-495289220983 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:30.872951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549fadb-8e60-4420-a930-c14780ba63b6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:30.884425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc9494-824e-4ac9-ba88-8d58be00985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:30.885281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc9494-824e-4ac9-ba88-8d58be00985f admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.885771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc9494-824e-4ac9-ba88-8d58be00985f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.886226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc9494-824e-4ac9-ba88-8d58be00985f admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.887269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc9494-824e-4ac9-ba88-8d58be00985f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:30.897401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc9494-824e-4ac9-ba88-8d58be00985f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:30.898096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03f350-2d6a-42c0-93fa-77f8ddf81e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:30.898607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03f350-2d6a-42c0-93fa-77f8ddf81e84 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.898953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03f350-2d6a-42c0-93fa-77f8ddf81e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.899272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03f350-2d6a-42c0-93fa-77f8ddf81e84 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.900167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03f350-2d6a-42c0-93fa-77f8ddf81e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:30.903986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03f350-2d6a-42c0-93fa-77f8ddf81e84 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:30.930386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1024/2054] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:30.938602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc9494-824e-4ac9-ba88-8d58be00985f admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:30.951322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc9494-824e-4ac9-ba88-8d58be00985f admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:30.956909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c6aac-0211-466b-95d5-520601a1dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:30.957852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c6aac-0211-466b-95d5-520601a1dabe admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:30.958361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c6aac-0211-466b-95d5-520601a1dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:30.958723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c6aac-0211-466b-95d5-520601a1dabe admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:30.959678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c6aac-0211-466b-95d5-520601a1dabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:30.961554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c6aac-0211-466b-95d5-520601a1dabe admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:30.979027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1025/2055] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:30.985440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c6aac-0211-466b-95d5-520601a1dabe admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:30.999162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c6aac-0211-466b-95d5-520601a1dabe admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:31.005615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13159424-99b2-4351-99a6-940d3662bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:31.006378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13159424-99b2-4351-99a6-940d3662bfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.006667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13159424-99b2-4351-99a6-940d3662bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.006941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13159424-99b2-4351-99a6-940d3662bfcd admin admin] PATH_INFO: `/v3/projects/ca213e0d48ae4f3fa087bc35e851d080/users/8419b1cfcc684060a780e2d87058144c/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.025777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:31.033608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13159424-99b2-4351-99a6-940d3662bfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca213e0d48ae4f3fa087bc35e851d080, user_id=8419b1cfcc684060a780e2d87058144c, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:31.037459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13159424-99b2-4351-99a6-940d3662bfcd admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:31.091509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1031/2056] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:30 2022] POST /identity/v3/users => generated 289 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:31.092999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03f350-2d6a-42c0-93fa-77f8ddf81e84 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:31.112815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03f350-2d6a-42c0-93fa-77f8ddf81e84 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:31.121839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b458b-94ea-4ab9-8495-cd68b358f786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:31.122824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b458b-94ea-4ab9-8495-cd68b358f786 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.123370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b458b-94ea-4ab9-8495-cd68b358f786 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.123848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b458b-94ea-4ab9-8495-cd68b358f786 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.124778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b458b-94ea-4ab9-8495-cd68b358f786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:31.127785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b458b-94ea-4ab9-8495-cd68b358f786 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:31.143596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1032/2057] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:31.147860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b458b-94ea-4ab9-8495-cd68b358f786 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:31.155049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1026/2058] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:30 2022] PUT /identity/v3/projects/ca213e0d48ae4f3fa087bc35e851d080/users/8419b1cfcc684060a780e2d87058144c/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:31.160854 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b458b-94ea-4ab9-8495-cd68b358f786 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:31.165382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e144c-a696-4033-964b-4f9afd53cc2f None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.165776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e144c-a696-4033-964b-4f9afd53cc2f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.166120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e144c-a696-4033-964b-4f9afd53cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.245111 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-787e144c-a696-4033-964b-4f9afd53cc2f None None] MFA Rules not processed for user `8419b1cfcc684060a780e2d87058144c`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:31.254172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-787e144c-a696-4033-964b-4f9afd53cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:31.303258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0b8f-7619-4d15-8f55-4d5c901412ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:31.303984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0b8f-7619-4d15-8f55-4d5c901412ea admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.304316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0b8f-7619-4d15-8f55-4d5c901412ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.304592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0b8f-7619-4d15-8f55-4d5c901412ea admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.305972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c0b8f-7619-4d15-8f55-4d5c901412ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:31.310754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c0b8f-7619-4d15-8f55-4d5c901412ea admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:31.348863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1027/2059] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:31.349549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1033/2060] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:31.351026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f9fc-5d6e-435a-af4a-1a246c6de2f8 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.351026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f9fc-5d6e-435a-af4a-1a246c6de2f8 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.351305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f9fc-5d6e-435a-af4a-1a246c6de2f8 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.352070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0b8f-7619-4d15-8f55-4d5c901412ea admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:31.352953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1028/2061] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 20:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:00:31.361194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f9fc-5d6e-435a-af4a-1a246c6de2f8 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:31.363790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4075f9fc-5d6e-435a-af4a-1a246c6de2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:31.388996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0b8f-7619-4d15-8f55-4d5c901412ea admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:31.414921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f1bcd-5c6a-40fd-9387-563515dce580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:31.415721 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f1bcd-5c6a-40fd-9387-563515dce580 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.416010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f1bcd-5c6a-40fd-9387-563515dce580 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.416287 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f1bcd-5c6a-40fd-9387-563515dce580 admin admin] PATH_INFO: `/v3/projects/a7877e4c28054b35a8a6f9ec8497e87a/users/38c6b50717c444edaa5906b6d95f8c9f/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.434070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f1bcd-5c6a-40fd-9387-563515dce580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7877e4c28054b35a8a6f9ec8497e87a, user_id=38c6b50717c444edaa5906b6d95f8c9f, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:31.436947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f1bcd-5c6a-40fd-9387-563515dce580 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:31.459480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f9fc-5d6e-435a-af4a-1a246c6de2f8 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:31.470175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcb164-6cb5-4f5e-9e50-1b77baf59e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:31.470889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcb164-6cb5-4f5e-9e50-1b77baf59e58 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.471175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcb164-6cb5-4f5e-9e50-1b77baf59e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.471667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcb164-6cb5-4f5e-9e50-1b77baf59e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.480969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcb164-6cb5-4f5e-9e50-1b77baf59e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:31.482554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bcb164-6cb5-4f5e-9e50-1b77baf59e58 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:31.493847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1029/2062] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:31.495309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ca3f7-ca39-4106-85cb-9bd268ad5749 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.495593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ca3f7-ca39-4106-85cb-9bd268ad5749 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.495870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ca3f7-ca39-4106-85cb-9bd268ad5749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.516218 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e12ca3f7-ca39-4106-85cb-9bd268ad5749 None None] MFA Rules not processed for user `1ef51739456e4beb9ae0f107b13d55f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:31.517813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e12ca3f7-ca39-4106-85cb-9bd268ad5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:31.549014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1034/2063] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:31 2022] PUT /identity/v3/projects/a7877e4c28054b35a8a6f9ec8497e87a/users/38c6b50717c444edaa5906b6d95f8c9f/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:31.560047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2940179-bc64-41aa-9d2f-56420524200d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.560952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2940179-bc64-41aa-9d2f-56420524200d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.560952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2940179-bc64-41aa-9d2f-56420524200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.612580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1030/2064] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 20:00:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:31.613603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ca3f7-ca39-4106-85cb-9bd268ad5749 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:31.615541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e12ca3f7-ca39-4106-85cb-9bd268ad5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:31.640957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ca3f7-ca39-4106-85cb-9bd268ad5749 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:31.651144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-a2940179-bc64-41aa-9d2f-56420524200d None None] MFA Rules not processed for user `38c6b50717c444edaa5906b6d95f8c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:31.653260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a2940179-bc64-41aa-9d2f-56420524200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:31.753976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:31.754488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.754618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.754966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] PATH_INFO: `/v3/users/6c831f26a1c344369b050ccf2bc24554` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.756306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c831f26a1c344369b050ccf2bc24554)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:31.758358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:31.774928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1035/2065] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:31.779755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2940179-bc64-41aa-9d2f-56420524200d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:31.781623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a2940179-bc64-41aa-9d2f-56420524200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:31.868910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2940179-bc64-41aa-9d2f-56420524200d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:31.874868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05117c1-1bc7-408a-9208-b8d0fd58558d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:31.876015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05117c1-1bc7-408a-9208-b8d0fd58558d service placement] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.876686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05117c1-1bc7-408a-9208-b8d0fd58558d service placement] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.877344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05117c1-1bc7-408a-9208-b8d0fd58558d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.890655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05117c1-1bc7-408a-9208-b8d0fd58558d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:31.892513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05117c1-1bc7-408a-9208-b8d0fd58558d service placement] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:31.907076 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:31.916222 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1036/2066] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:31.918967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05117c1-1bc7-408a-9208-b8d0fd58558d service placement] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:31.938096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05117c1-1bc7-408a-9208-b8d0fd58558d service placement] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:31.963549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283e7f4-3d45-4b33-ab4a-1a9df5123b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:31.963549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283e7f4-3d45-4b33-ab4a-1a9df5123b1f admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:31.963549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283e7f4-3d45-4b33-ab4a-1a9df5123b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:31.963549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283e7f4-3d45-4b33-ab4a-1a9df5123b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:31.963916 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283e7f4-3d45-4b33-ab4a-1a9df5123b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:31.964798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283e7f4-3d45-4b33-ab4a-1a9df5123b1f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:31.975424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c831f26a1c344369b050ccf2bc24554'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:31.976351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c831f26a1c344369b050ccf2bc24554'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:31.999702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c831f26a1c344369b050ccf2bc24554'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:32.069454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c831f26a1c344369b050ccf2bc24554'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:32.082304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1037/2067] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:31 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:32.089992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283e7f4-3d45-4b33-ab4a-1a9df5123b1f admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:32.093035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a283e7f4-3d45-4b33-ab4a-1a9df5123b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:32.095515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c831f26a1c344369b050ccf2bc24554'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:32.112555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1031/2068] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:31 2022] DELETE /identity/v3/users/6c831f26a1c344369b050ccf2bc24554 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:32.179801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283e7f4-3d45-4b33-ab4a-1a9df5123b1f admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:32.250466 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5c582-de6f-4040-8eeb-8e5b910c8c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:32.251180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5c582-de6f-4040-8eeb-8e5b910c8c9e admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.251487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5c582-de6f-4040-8eeb-8e5b910c8c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.251760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5c582-de6f-4040-8eeb-8e5b910c8c9e admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.252502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5c582-de6f-4040-8eeb-8e5b910c8c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:32.254353 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5c582-de6f-4040-8eeb-8e5b910c8c9e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:32.407842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1038/2069] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:32 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:32.418072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:32.429234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b891-8a01-4d06-8d6e-c6353a770530 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:32.434885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21808ad4-612b-44b1-ab51-0db88c463b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:32.435701 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21808ad4-612b-44b1-ab51-0db88c463b4c admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.436304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21808ad4-612b-44b1-ab51-0db88c463b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.436718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21808ad4-612b-44b1-ab51-0db88c463b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.437819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21808ad4-612b-44b1-ab51-0db88c463b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:32.440047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21808ad4-612b-44b1-ab51-0db88c463b4c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:32.445873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5c582-de6f-4040-8eeb-8e5b910c8c9e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:32.449579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e2b5c582-de6f-4040-8eeb-8e5b910c8c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:32.461451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1032/2070] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:32.462715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21808ad4-612b-44b1-ab51-0db88c463b4c admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:32.476618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5c582-de6f-4040-8eeb-8e5b910c8c9e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:32.481606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:32.482243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.482526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.482823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] PATH_INFO: `/v3/projects/771923c3e25b49b6992ff740890cb9d7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.484040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=771923c3e25b49b6992ff740890cb9d7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:32.485578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21808ad4-612b-44b1-ab51-0db88c463b4c admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:32.486390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:32.493040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062ba7b-f8f6-4fd0-aa92-f45a14ba1cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:32.493653 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ba7b-f8f6-4fd0-aa92-f45a14ba1cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.493932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ba7b-f8f6-4fd0-aa92-f45a14ba1cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.494203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ba7b-f8f6-4fd0-aa92-f45a14ba1cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.494856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062ba7b-f8f6-4fd0-aa92-f45a14ba1cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:32.496613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062ba7b-f8f6-4fd0-aa92-f45a14ba1cb8 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:32.512945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1033/2071] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:32.516317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062ba7b-f8f6-4fd0-aa92-f45a14ba1cb8 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:32.533430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062ba7b-f8f6-4fd0-aa92-f45a14ba1cb8 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:32.538568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:32.545526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61d231-b2c9-4f3d-b94b-ee910e84f82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:32.546670 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d231-b2c9-4f3d-b94b-ee910e84f82b admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.547110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d231-b2c9-4f3d-b94b-ee910e84f82b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.548342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d231-b2c9-4f3d-b94b-ee910e84f82b admin admin] PATH_INFO: `/v3/projects/126c56e2ce0647b29af6c46073343b86/users/6648e4a9aef64f3b986937aeee4944c5/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.569247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61d231-b2c9-4f3d-b94b-ee910e84f82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=126c56e2ce0647b29af6c46073343b86, user_id=6648e4a9aef64f3b986937aeee4944c5, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:32.572251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61d231-b2c9-4f3d-b94b-ee910e84f82b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:32.655777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1034/2072] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:32 2022] PUT /identity/v3/projects/126c56e2ce0647b29af6c46073343b86/users/6648e4a9aef64f3b986937aeee4944c5/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:32.672312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb204b78-a4a8-40e7-8981-54628d6fedeb None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.672617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb204b78-a4a8-40e7-8981-54628d6fedeb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.672872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb204b78-a4a8-40e7-8981-54628d6fedeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.692908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771923c3e25b49b6992ff740890cb9d7', 'request_id': 'req-8e89066d-f36f-4a46-99ec-e312eb32ae7b'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:32.702187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771923c3e25b49b6992ff740890cb9d7', 'request_id': 'req-8e89066d-f36f-4a46-99ec-e312eb32ae7b'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:32.706419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-bb204b78-a4a8-40e7-8981-54628d6fedeb None None] MFA Rules not processed for user `6648e4a9aef64f3b986937aeee4944c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:32.708344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bb204b78-a4a8-40e7-8981-54628d6fedeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:32.797597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1035/2073] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:32.803165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb204b78-a4a8-40e7-8981-54628d6fedeb None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:32.842653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771923c3e25b49b6992ff740890cb9d7', 'request_id': 'req-8e89066d-f36f-4a46-99ec-e312eb32ae7b'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:32.855293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] The token cache is being invalidate because project 771923c3e25b49b6992ff740890cb9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:32.856231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:32.857447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8e89066d-f36f-4a46-99ec-e312eb32ae7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:32.860711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1039/2074] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:32 2022] DELETE /identity/v3/projects/771923c3e25b49b6992ff740890cb9d7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:32.866081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15b876-901f-4e92-800c-362aeded7f6e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.866617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15b876-901f-4e92-800c-362aeded7f6e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.866872 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15b876-901f-4e92-800c-362aeded7f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.885195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb204b78-a4a8-40e7-8981-54628d6fedeb None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:32.890778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdededfe-1577-4173-938f-87e6f31da2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:32.891693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-de15b876-901f-4e92-800c-362aeded7f6e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:32.891979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdededfe-1577-4173-938f-87e6f31da2fb admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.892480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdededfe-1577-4173-938f-87e6f31da2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.892937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-de15b876-901f-4e92-800c-362aeded7f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:32.893181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdededfe-1577-4173-938f-87e6f31da2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.894012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdededfe-1577-4173-938f-87e6f31da2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:32.897524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdededfe-1577-4173-938f-87e6f31da2fb admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:32.903362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1040/2075] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:32.913495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921f5d9-0ed0-4051-bfc2-b84fe823b2b0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.914114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921f5d9-0ed0-4051-bfc2-b84fe823b2b0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.914578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921f5d9-0ed0-4051-bfc2-b84fe823b2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.936941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7921f5d9-0ed0-4051-bfc2-b84fe823b2b0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:32.938528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7921f5d9-0ed0-4051-bfc2-b84fe823b2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:32.953166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1041/2076] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:32.953983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921f5d9-0ed0-4051-bfc2-b84fe823b2b0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:32.965355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921f5d9-0ed0-4051-bfc2-b84fe823b2b0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:32.970555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4388-921f-4448-bfd4-879237fba816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:32.971180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4388-921f-4448-bfd4-879237fba816 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:32.971869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4388-921f-4448-bfd4-879237fba816 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:32.975485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e4388-921f-4448-bfd4-879237fba816 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:32.975485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4388-921f-4448-bfd4-879237fba816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:32.975485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4388-921f-4448-bfd4-879237fba816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:32.975485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e4388-921f-4448-bfd4-879237fba816 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:32.988659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1042/2077] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:32.993138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4388-921f-4448-bfd4-879237fba816 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.003277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1036/2078] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:32 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:33.003940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e4388-921f-4448-bfd4-879237fba816 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.007328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdededfe-1577-4173-938f-87e6f31da2fb admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.009116 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bdededfe-1577-4173-938f-87e6f31da2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:33.076046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47ade0-f754-4bbe-a092-fa625ae485ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.076787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47ade0-f754-4bbe-a092-fa625ae485ca admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.077126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47ade0-f754-4bbe-a092-fa625ae485ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.077569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47ade0-f754-4bbe-a092-fa625ae485ca admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.078560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47ade0-f754-4bbe-a092-fa625ae485ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.081125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47ade0-f754-4bbe-a092-fa625ae485ca admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.102056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdededfe-1577-4173-938f-87e6f31da2fb admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.111945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5a2bc-76b8-465f-86ad-d8d10eac0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.112645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5a2bc-76b8-465f-86ad-d8d10eac0eaa admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.112992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5a2bc-76b8-465f-86ad-d8d10eac0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.113383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5a2bc-76b8-465f-86ad-d8d10eac0eaa admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.114702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5a2bc-76b8-465f-86ad-d8d10eac0eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.117057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5a2bc-76b8-465f-86ad-d8d10eac0eaa admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.197999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1043/2079] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:32 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:33.208872 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1037/2080] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:33 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:33.210585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5a2bc-76b8-465f-86ad-d8d10eac0eaa admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.211432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47ade0-f754-4bbe-a092-fa625ae485ca admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.228762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5a2bc-76b8-465f-86ad-d8d10eac0eaa admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.310606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47ade0-f754-4bbe-a092-fa625ae485ca admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.321774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcc48f-2fde-4208-99a0-908a33ed8b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.322871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcc48f-2fde-4208-99a0-908a33ed8b4d admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.323994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcc48f-2fde-4208-99a0-908a33ed8b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.324516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcc48f-2fde-4208-99a0-908a33ed8b4d admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.325438 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcc48f-2fde-4208-99a0-908a33ed8b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.327544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcc48f-2fde-4208-99a0-908a33ed8b4d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.341475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14856fbb-2ff1-46d1-a8ee-78007c465434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.342244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14856fbb-2ff1-46d1-a8ee-78007c465434 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.342552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14856fbb-2ff1-46d1-a8ee-78007c465434 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.342833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14856fbb-2ff1-46d1-a8ee-78007c465434 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.343531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14856fbb-2ff1-46d1-a8ee-78007c465434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.345217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14856fbb-2ff1-46d1-a8ee-78007c465434 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.360191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1038/2081] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:33.362090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14856fbb-2ff1-46d1-a8ee-78007c465434 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.372849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14856fbb-2ff1-46d1-a8ee-78007c465434 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.377599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed949de-0467-4310-b59c-ba5be5871339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.378268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed949de-0467-4310-b59c-ba5be5871339 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.378542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed949de-0467-4310-b59c-ba5be5871339 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.378813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed949de-0467-4310-b59c-ba5be5871339 admin admin] PATH_INFO: `/v3/projects/048f5a65aaa34d919f1fd73f0859d05f/users/5aeb183a599741feb8b584ca9d024542/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.409815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed949de-0467-4310-b59c-ba5be5871339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=048f5a65aaa34d919f1fd73f0859d05f, user_id=5aeb183a599741feb8b584ca9d024542, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.409815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed949de-0467-4310-b59c-ba5be5871339 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.426035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1044/2082] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:33 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:33.430607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcc48f-2fde-4208-99a0-908a33ed8b4d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.449875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcc48f-2fde-4208-99a0-908a33ed8b4d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.458149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6cdb3-4d87-423b-9248-1e64b7923313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.460308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6cdb3-4d87-423b-9248-1e64b7923313 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.460786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6cdb3-4d87-423b-9248-1e64b7923313 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.461264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6cdb3-4d87-423b-9248-1e64b7923313 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.462427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6cdb3-4d87-423b-9248-1e64b7923313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.465530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6cdb3-4d87-423b-9248-1e64b7923313 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.487267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1045/2083] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:33.489632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6cdb3-4d87-423b-9248-1e64b7923313 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.490355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1039/2084] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:33 2022] PUT /identity/v3/projects/048f5a65aaa34d919f1fd73f0859d05f/users/5aeb183a599741feb8b584ca9d024542/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:33.496925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed949de-0467-4310-b59c-ba5be5871339 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.510116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6cdb3-4d87-423b-9248-1e64b7923313 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.584711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:33.600733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc201d-f56d-4b5e-bf9c-e1fc2e4a830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.602044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed949de-0467-4310-b59c-ba5be5871339 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.602154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc201d-f56d-4b5e-bf9c-e1fc2e4a830c admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.602154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc201d-f56d-4b5e-bf9c-e1fc2e4a830c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.602154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc201d-f56d-4b5e-bf9c-e1fc2e4a830c admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.603107 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc201d-f56d-4b5e-bf9c-e1fc2e4a830c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.604870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc201d-f56d-4b5e-bf9c-e1fc2e4a830c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.606272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18566f-e291-46ea-b142-44b7d0cb5c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.606969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18566f-e291-46ea-b142-44b7d0cb5c89 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.607277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18566f-e291-46ea-b142-44b7d0cb5c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.607552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18566f-e291-46ea-b142-44b7d0cb5c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.608207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18566f-e291-46ea-b142-44b7d0cb5c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.610099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18566f-e291-46ea-b142-44b7d0cb5c89 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.624242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1046/2085] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:33.624242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc201d-f56d-4b5e-bf9c-e1fc2e4a830c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.624520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1040/2086] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:33.626493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18566f-e291-46ea-b142-44b7d0cb5c89 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.632793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc201d-f56d-4b5e-bf9c-e1fc2e4a830c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.637922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18566f-e291-46ea-b142-44b7d0cb5c89 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.646444 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbdee8-b236-4ccd-acee-834eacbf734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.647253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbdee8-b236-4ccd-acee-834eacbf734c admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.647568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbdee8-b236-4ccd-acee-834eacbf734c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.647886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbdee8-b236-4ccd-acee-834eacbf734c admin admin] PATH_INFO: `/v3/projects/9515c6f4ac5f422abc115e3c0933fe3a/users/d8eb94d16f8043a59aae35751c52875c/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.647992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1569b-b10b-41ca-aa40-b93bdff406ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.648686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1569b-b10b-41ca-aa40-b93bdff406ea admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.648907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1569b-b10b-41ca-aa40-b93bdff406ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.649188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1569b-b10b-41ca-aa40-b93bdff406ea admin admin] PATH_INFO: `/v3/projects/048f5a65aaa34d919f1fd73f0859d05f/users/5aeb183a599741feb8b584ca9d024542/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.651684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1569b-b10b-41ca-aa40-b93bdff406ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=048f5a65aaa34d919f1fd73f0859d05f, user_id=5aeb183a599741feb8b584ca9d024542, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.654521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1569b-b10b-41ca-aa40-b93bdff406ea admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.676712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbdee8-b236-4ccd-acee-834eacbf734c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9515c6f4ac5f422abc115e3c0933fe3a, user_id=d8eb94d16f8043a59aae35751c52875c, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:33.676712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbdee8-b236-4ccd-acee-834eacbf734c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:33.677962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1041/2087] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:33 2022] PUT /identity/v3/projects/048f5a65aaa34d919f1fd73f0859d05f/users/5aeb183a599741feb8b584ca9d024542/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:33.683255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79e78c-b69d-4f19-bfc6-fba83a3f7d7a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.683572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79e78c-b69d-4f19-bfc6-fba83a3f7d7a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.683855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79e78c-b69d-4f19-bfc6-fba83a3f7d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.715148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-3a79e78c-b69d-4f19-bfc6-fba83a3f7d7a None None] MFA Rules not processed for user `5aeb183a599741feb8b584ca9d024542`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:33.716462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3a79e78c-b69d-4f19-bfc6-fba83a3f7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:33.752837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1047/2088] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:33 2022] PUT /identity/v3/projects/9515c6f4ac5f422abc115e3c0933fe3a/users/d8eb94d16f8043a59aae35751c52875c/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:33.767249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a877a1-a778-4f7a-bc8d-ce9dcfe1dca1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.767539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a877a1-a778-4f7a-bc8d-ce9dcfe1dca1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.767822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a877a1-a778-4f7a-bc8d-ce9dcfe1dca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:33.803525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-80a877a1-a778-4f7a-bc8d-ce9dcfe1dca1 None None] MFA Rules not processed for user `d8eb94d16f8043a59aae35751c52875c`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:33.804933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-80a877a1-a778-4f7a-bc8d-ce9dcfe1dca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:33.809642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1042/2089] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:33.825882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79e78c-b69d-4f19-bfc6-fba83a3f7d7a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.827593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3a79e78c-b69d-4f19-bfc6-fba83a3f7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:33.902306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79e78c-b69d-4f19-bfc6-fba83a3f7d7a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:33.931110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1048/2090] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:33.935784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a877a1-a778-4f7a-bc8d-ce9dcfe1dca1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:33.978917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdc8a5-0282-4ea0-8696-43e5c25e5f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:33.979585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdc8a5-0282-4ea0-8696-43e5c25e5f89 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:33.979867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdc8a5-0282-4ea0-8696-43e5c25e5f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:33.980142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdc8a5-0282-4ea0-8696-43e5c25e5f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:34.059772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a877a1-a778-4f7a-bc8d-ce9dcfe1dca1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:34.065711 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d18bae-3328-48d1-82c8-b604af5a9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:34.066730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d18bae-3328-48d1-82c8-b604af5a9b82 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:34.066730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d18bae-3328-48d1-82c8-b604af5a9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:34.066990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d18bae-3328-48d1-82c8-b604af5a9b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:34.067719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdc8a5-0282-4ea0-8696-43e5c25e5f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:34.068358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d18bae-3328-48d1-82c8-b604af5a9b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:34.069244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdc8a5-0282-4ea0-8696-43e5c25e5f89 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:34.070565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d18bae-3328-48d1-82c8-b604af5a9b82 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:34.081329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1043/2091] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:00:34.186048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1049/2092] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:33 2022] POST /identity/v3/projects => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:34.187977 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdc8a5-0282-4ea0-8696-43e5c25e5f89 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:34.205584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdc8a5-0282-4ea0-8696-43e5c25e5f89 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:34.251448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d18bae-3328-48d1-82c8-b604af5a9b82 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:34.272528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d7b21-28a9-4d1c-82ae-a652be150a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:34.273147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d7b21-28a9-4d1c-82ae-a652be150a8d admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:34.273432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d7b21-28a9-4d1c-82ae-a652be150a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:34.273805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d7b21-28a9-4d1c-82ae-a652be150a8d admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:34.274326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d7b21-28a9-4d1c-82ae-a652be150a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:34.279805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d7b21-28a9-4d1c-82ae-a652be150a8d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:34.329110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d18bae-3328-48d1-82c8-b604af5a9b82 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:34.333718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82e510-a220-45cf-b185-787d32d16b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:34.334335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82e510-a220-45cf-b185-787d32d16b1e service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:34.334609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82e510-a220-45cf-b185-787d32d16b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:34.334946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82e510-a220-45cf-b185-787d32d16b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:34.336862 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8f82e510-a220-45cf-b185-787d32d16b1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:34.386469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1044/2093] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:34 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:34.390252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d7b21-28a9-4d1c-82ae-a652be150a8d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:34.402895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d7b21-28a9-4d1c-82ae-a652be150a8d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:34.403785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82e510-a220-45cf-b185-787d32d16b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:34.408575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82e510-a220-45cf-b185-787d32d16b1e service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:34.412662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00dfb3-c6be-4128-8a51-70adecfc879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:34.415605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00dfb3-c6be-4128-8a51-70adecfc879d admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:34.415605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00dfb3-c6be-4128-8a51-70adecfc879d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:34.415605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00dfb3-c6be-4128-8a51-70adecfc879d admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:34.415605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00dfb3-c6be-4128-8a51-70adecfc879d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:34.416181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00dfb3-c6be-4128-8a51-70adecfc879d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:34.418958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1050/2094] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:00:34.439041 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82e510-a220-45cf-b185-787d32d16b1e service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:34.439265 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1045/2095] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:34.449293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82e510-a220-45cf-b185-787d32d16b1e service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:34.454652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601d60a-a795-4810-960b-a1ba389ca892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:34.455286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:34.455497 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d60a-a795-4810-960b-a1ba389ca892 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:34.455842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d60a-a795-4810-960b-a1ba389ca892 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:34.456175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d60a-a795-4810-960b-a1ba389ca892 admin admin] PATH_INFO: `/v3/projects/b3c059d4a2fa4fb190f6e0007e6d1a8a/users/45f0b76d77e04846bbfed78747ba381d/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:34.475101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601d60a-a795-4810-960b-a1ba389ca892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c059d4a2fa4fb190f6e0007e6d1a8a, user_id=45f0b76d77e04846bbfed78747ba381d, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:34.478032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601d60a-a795-4810-960b-a1ba389ca892 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:34.576719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1051/2096] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:34 2022] PUT /identity/v3/projects/b3c059d4a2fa4fb190f6e0007e6d1a8a/users/45f0b76d77e04846bbfed78747ba381d/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:34.578459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00dfb3-c6be-4128-8a51-70adecfc879d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:34.590284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00dfb3-c6be-4128-8a51-70adecfc879d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:34.703952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712782e7-e2f7-4ed5-893b-4d25b8003423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:34.704585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712782e7-e2f7-4ed5-893b-4d25b8003423 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:34.704866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712782e7-e2f7-4ed5-893b-4d25b8003423 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:34.705197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712782e7-e2f7-4ed5-893b-4d25b8003423 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:34.705861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712782e7-e2f7-4ed5-893b-4d25b8003423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:34.707630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712782e7-e2f7-4ed5-893b-4d25b8003423 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:34.719634 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1046/2097] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:34.724998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601d60a-a795-4810-960b-a1ba389ca892 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:34.740884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601d60a-a795-4810-960b-a1ba389ca892 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:34.748487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce8be3-46e5-44fb-8e8c-a6abf3b8ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:34.754333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce8be3-46e5-44fb-8e8c-a6abf3b8ab64 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:34.754333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce8be3-46e5-44fb-8e8c-a6abf3b8ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:34.754333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce8be3-46e5-44fb-8e8c-a6abf3b8ab64 admin admin] PATH_INFO: `/v3/projects/b3c059d4a2fa4fb190f6e0007e6d1a8a/users/45f0b76d77e04846bbfed78747ba381d/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:34.754333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce8be3-46e5-44fb-8e8c-a6abf3b8ab64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c059d4a2fa4fb190f6e0007e6d1a8a, user_id=45f0b76d77e04846bbfed78747ba381d, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:34.755790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce8be3-46e5-44fb-8e8c-a6abf3b8ab64 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:34.780754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1052/2098] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:34 2022] PUT /identity/v3/projects/b3c059d4a2fa4fb190f6e0007e6d1a8a/users/45f0b76d77e04846bbfed78747ba381d/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:34.782813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d9d3b-7144-463d-ab76-db82f328b60b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:34.784071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d9d3b-7144-463d-ab76-db82f328b60b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:34.784357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d9d3b-7144-463d-ab76-db82f328b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:34.823995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-5c7d9d3b-7144-463d-ab76-db82f328b60b None None] MFA Rules not processed for user `45f0b76d77e04846bbfed78747ba381d`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:34.825174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5c7d9d3b-7144-463d-ab76-db82f328b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:34.919058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1047/2099] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:35.249488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:35.288598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce8be3-46e5-44fb-8e8c-a6abf3b8ab64 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:35.291366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b0ce8be3-46e5-44fb-8e8c-a6abf3b8ab64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:35.386362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce8be3-46e5-44fb-8e8c-a6abf3b8ab64 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:35.390549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fc4e6-4112-434e-b764-9664567de09c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:35.391821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fc4e6-4112-434e-b764-9664567de09c service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:35.392203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fc4e6-4112-434e-b764-9664567de09c service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:35.392679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fc4e6-4112-434e-b764-9664567de09c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:35.404068 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fc4e6-4112-434e-b764-9664567de09c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:35.417998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fc4e6-4112-434e-b764-9664567de09c service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:35.429375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1053/2100] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:35.545774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d9d3b-7144-463d-ab76-db82f328b60b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:35.560935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d9d3b-7144-463d-ab76-db82f328b60b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:35.565340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91264b3c-9688-44f9-8170-08dea2204bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:35.566228 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91264b3c-9688-44f9-8170-08dea2204bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:35.566658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91264b3c-9688-44f9-8170-08dea2204bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:35.567046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91264b3c-9688-44f9-8170-08dea2204bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:35.631346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91264b3c-9688-44f9-8170-08dea2204bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:35.632807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91264b3c-9688-44f9-8170-08dea2204bd6 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:35.642785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1048/2101] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:35.977885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:36.235007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:36.997097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:37.177886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:37.825944 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:38.260532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:38.420867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fc4e6-4112-434e-b764-9664567de09c service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:38.429400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fc4e6-4112-434e-b764-9664567de09c service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:38.433089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e3738-0ef9-4d40-b2aa-30f6ddc20eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:38.433684 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3738-0ef9-4d40-b2aa-30f6ddc20eae service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:38.433962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3738-0ef9-4d40-b2aa-30f6ddc20eae service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:38.434228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e3738-0ef9-4d40-b2aa-30f6ddc20eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:38.437560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f52e3738-0ef9-4d40-b2aa-30f6ddc20eae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:38.519432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e3738-0ef9-4d40-b2aa-30f6ddc20eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:38.521870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e3738-0ef9-4d40-b2aa-30f6ddc20eae service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:38.533909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1054/2102] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:38.551256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:39.298950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91264b3c-9688-44f9-8170-08dea2204bd6 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:39.375564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91264b3c-9688-44f9-8170-08dea2204bd6 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:39.381264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:39.381904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:39.382177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:39.382446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] PATH_INFO: `/v3/users/38c6b50717c444edaa5906b6d95f8c9f` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:39.383617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c6b50717c444edaa5906b6d95f8c9f)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:39.386261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:39.389944 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:39.566084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c6b50717c444edaa5906b6d95f8c9f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:39.566852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c6b50717c444edaa5906b6d95f8c9f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:39.569091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:39.577232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c6b50717c444edaa5906b6d95f8c9f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:39.657086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c6b50717c444edaa5906b6d95f8c9f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:39.674748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c6b50717c444edaa5906b6d95f8c9f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:39.682214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1049/2103] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:39 2022] DELETE /identity/v3/users/38c6b50717c444edaa5906b6d95f8c9f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:39.686915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88964a-e386-4dd4-9158-8475f40396f6 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:39.687200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88964a-e386-4dd4-9158-8475f40396f6 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:39.687513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88964a-e386-4dd4-9158-8475f40396f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:39.709001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-5e88964a-e386-4dd4-9158-8475f40396f6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:39.710225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5e88964a-e386-4dd4-9158-8475f40396f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:39.776759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1055/2104] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:39.787376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:39.789550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:39.871080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfc4a0-cbb8-465d-9c55-acaa64f25553 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:39.882578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81def4-3e22-4d9a-9ddb-d3084a17f610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:39.883719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81def4-3e22-4d9a-9ddb-d3084a17f610 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:39.884142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81def4-3e22-4d9a-9ddb-d3084a17f610 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:39.884800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81def4-3e22-4d9a-9ddb-d3084a17f610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:39.905577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81def4-3e22-4d9a-9ddb-d3084a17f610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:39.905577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81def4-3e22-4d9a-9ddb-d3084a17f610 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:39.912161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1050/2105] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:40.118648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:40.220690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:40.648793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:40.734413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88964a-e386-4dd4-9158-8475f40396f6 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:40.736223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5e88964a-e386-4dd4-9158-8475f40396f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:40.749268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88964a-e386-4dd4-9158-8475f40396f6 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:40.755466 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:40.756329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:40.756603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:40.757060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] PATH_INFO: `/v3/projects/a7877e4c28054b35a8a6f9ec8497e87a` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:40.758839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7877e4c28054b35a8a6f9ec8497e87a)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:40.760963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:40.912613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7877e4c28054b35a8a6f9ec8497e87a', 'request_id': 'req-3b4230d3-3eed-4070-9013-e3a90cc73307'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:40.919189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7877e4c28054b35a8a6f9ec8497e87a', 'request_id': 'req-3b4230d3-3eed-4070-9013-e3a90cc73307'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:40.994769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7877e4c28054b35a8a6f9ec8497e87a', 'request_id': 'req-3b4230d3-3eed-4070-9013-e3a90cc73307'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.006695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] The token cache is being invalidate because project a7877e4c28054b35a8a6f9ec8497e87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:41.006989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.007674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.009304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1056/2106] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:40 2022] DELETE /identity/v3/projects/a7877e4c28054b35a8a6f9ec8497e87a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:41.013315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81def4-3e22-4d9a-9ddb-d3084a17f610 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:41.024904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81def4-3e22-4d9a-9ddb-d3084a17f610 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:41.106020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:41.106787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:41.107095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:41.107461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] PATH_INFO: `/v3/users/6648e4a9aef64f3b986937aeee4944c5` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:41.111990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6648e4a9aef64f3b986937aeee4944c5)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:41.114075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:41.286965 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:41.288510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:41.301399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4230d3-3eed-4070-9013-e3a90cc73307 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:41.306132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:41.306774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:41.307077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:41.307378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] PATH_INFO: `/v3/users/d8eb94d16f8043a59aae35751c52875c` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:41.308492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8eb94d16f8043a59aae35751c52875c)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:41.310412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:41.362732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:41.376049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6648e4a9aef64f3b986937aeee4944c5'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.376717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6648e4a9aef64f3b986937aeee4944c5'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.384235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6648e4a9aef64f3b986937aeee4944c5'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.458401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6648e4a9aef64f3b986937aeee4944c5'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.473749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e4bbcd8-0b81-4127-a14b-1a100e9f9186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6648e4a9aef64f3b986937aeee4944c5'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.480885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1051/2107] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:41 2022] DELETE /identity/v3/users/6648e4a9aef64f3b986937aeee4944c5 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:41.527960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8eb94d16f8043a59aae35751c52875c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.528918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8eb94d16f8043a59aae35751c52875c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.545563 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:41.646316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8eb94d16f8043a59aae35751c52875c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.654485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8eb94d16f8043a59aae35751c52875c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.667958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8eb94d16f8043a59aae35751c52875c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:41.674481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1057/2108] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:41 2022] DELETE /identity/v3/users/d8eb94d16f8043a59aae35751c52875c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:41.680118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac1dbe-2c86-4633-b982-6276bf0daf8f None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:41.680401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac1dbe-2c86-4633-b982-6276bf0daf8f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:41.680676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac1dbe-2c86-4633-b982-6276bf0daf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:41.702029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ceac1dbe-2c86-4633-b982-6276bf0daf8f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:41.703556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ceac1dbe-2c86-4633-b982-6276bf0daf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:41.780284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1052/2109] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:41.787185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:41.788950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:41.875316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a31bf-1e24-4ae4-a0e4-1bc3ee40aeb4 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:41.880086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f24f5-f012-4706-ad31-520e41438e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:41.881379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f24f5-f012-4706-ad31-520e41438e4b service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:41.881630 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f24f5-f012-4706-ad31-520e41438e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:41.881901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f24f5-f012-4706-ad31-520e41438e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:41.893220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f24f5-f012-4706-ad31-520e41438e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:41.897618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f24f5-f012-4706-ad31-520e41438e4b service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:41.915176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1058/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:42.060214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac1dbe-2c86-4633-b982-6276bf0daf8f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:42.062080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ceac1dbe-2c86-4633-b982-6276bf0daf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:42.085429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac1dbe-2c86-4633-b982-6276bf0daf8f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:42.090293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:42.090935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:42.091241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:42.091523 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] PATH_INFO: `/v3/projects/126c56e2ce0647b29af6c46073343b86` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:42.092696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=126c56e2ce0647b29af6c46073343b86)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:42.094827 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:42.212223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:42.230577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126c56e2ce0647b29af6c46073343b86', 'request_id': 'req-bfb6427e-0008-44ff-8207-360a2c928c77'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:42.238103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126c56e2ce0647b29af6c46073343b86', 'request_id': 'req-bfb6427e-0008-44ff-8207-360a2c928c77'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:42.245930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126c56e2ce0647b29af6c46073343b86', 'request_id': 'req-bfb6427e-0008-44ff-8207-360a2c928c77'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:42.373921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] The token cache is being invalidate because project 126c56e2ce0647b29af6c46073343b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:42.377484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:42.377484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:42.377484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1053/2111] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:42 2022] DELETE /identity/v3/projects/126c56e2ce0647b29af6c46073343b86 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:42.381277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f24f5-f012-4706-ad31-520e41438e4b service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:42.403089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f24f5-f012-4706-ad31-520e41438e4b service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:42.485865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:42.487556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:42.487556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:42.487556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] PATH_INFO: `/v3/users/5aeb183a599741feb8b584ca9d024542` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:42.488297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aeb183a599741feb8b584ca9d024542)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:42.491189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:42.897088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:42.898653 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:42.938221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6427e-0008-44ff-8207-360a2c928c77 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:42.947490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:42.948341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:42.948624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:42.948900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] PATH_INFO: `/v3/projects/9515c6f4ac5f422abc115e3c0933fe3a` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:42.950327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9515c6f4ac5f422abc115e3c0933fe3a)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:42.952330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:43.036567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aeb183a599741feb8b584ca9d024542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.036567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aeb183a599741feb8b584ca9d024542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.040703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:43.077407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9515c6f4ac5f422abc115e3c0933fe3a', 'request_id': 'req-a03febda-b376-4e5d-b74e-71ac00845f6e'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.085117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9515c6f4ac5f422abc115e3c0933fe3a', 'request_id': 'req-a03febda-b376-4e5d-b74e-71ac00845f6e'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.092068 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9515c6f4ac5f422abc115e3c0933fe3a', 'request_id': 'req-a03febda-b376-4e5d-b74e-71ac00845f6e'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.174349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aeb183a599741feb8b584ca9d024542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.186084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aeb183a599741feb8b584ca9d024542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.201226 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aeb183a599741feb8b584ca9d024542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.208456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1059/2112] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:42 2022] DELETE /identity/v3/users/5aeb183a599741feb8b584ca9d024542 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:43.324455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] The token cache is being invalidate because project 9515c6f4ac5f422abc115e3c0933fe3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:43.324965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.325838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.328281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1054/2113] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:42 2022] DELETE /identity/v3/projects/9515c6f4ac5f422abc115e3c0933fe3a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:43.331931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:43.333427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:43.402631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c4dde-23a7-472c-bbcd-2e2190f9d247 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:43.407408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:43.408072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:43.408399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:43.408674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] PATH_INFO: `/v3/users/45f0b76d77e04846bbfed78747ba381d` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:43.410407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f0b76d77e04846bbfed78747ba381d)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:43.412975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:43.622841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f0b76d77e04846bbfed78747ba381d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.623600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f0b76d77e04846bbfed78747ba381d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.673144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:43.677935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:43.695784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f0b76d77e04846bbfed78747ba381d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.705557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f0b76d77e04846bbfed78747ba381d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.722282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-fc1f1c08-0c7d-4443-8e52-56914f1f1101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f0b76d77e04846bbfed78747ba381d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.731381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1060/2114] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:43 2022] DELETE /identity/v3/users/45f0b76d77e04846bbfed78747ba381d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:43.761146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03febda-b376-4e5d-b74e-71ac00845f6e admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:43.822312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:43.822957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:43.823255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:43.823539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] PATH_INFO: `/v3/projects/048f5a65aaa34d919f1fd73f0859d05f` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:43.824733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] RBAC: Authorizing `identity:delete_project(project_id=048f5a65aaa34d919f1fd73f0859d05f)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:43.826626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:43.966216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048f5a65aaa34d919f1fd73f0859d05f', 'request_id': 'req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.979491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048f5a65aaa34d919f1fd73f0859d05f', 'request_id': 'req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:43.989028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048f5a65aaa34d919f1fd73f0859d05f', 'request_id': 'req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:44.064779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] The token cache is being invalidate because project 048f5a65aaa34d919f1fd73f0859d05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:44.065074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:44.066001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2d2cbb05-d67f-42ee-90d7-417a8d2a117d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:44.072859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1055/2115] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:43 2022] DELETE /identity/v3/projects/048f5a65aaa34d919f1fd73f0859d05f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:44.074544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a695-4c5c-46f8-99cc-00b691e95e9d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.075098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a695-4c5c-46f8-99cc-00b691e95e9d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.075098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a695-4c5c-46f8-99cc-00b691e95e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.075851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:44.104942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7157a695-4c5c-46f8-99cc-00b691e95e9d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:44.108197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7157a695-4c5c-46f8-99cc-00b691e95e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:44.178683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1061/2116] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:44.187714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b06fa1-378e-4cad-af2e-ec5ce84a838c None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.188296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b06fa1-378e-4cad-af2e-ec5ce84a838c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.188296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b06fa1-378e-4cad-af2e-ec5ce84a838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.214497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-c4b06fa1-378e-4cad-af2e-ec5ce84a838c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:44.215766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c4b06fa1-378e-4cad-af2e-ec5ce84a838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:44.226997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1056/2117] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:44.228882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157a695-4c5c-46f8-99cc-00b691e95e9d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.230730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b06fa1-378e-4cad-af2e-ec5ce84a838c None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.232381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c4b06fa1-378e-4cad-af2e-ec5ce84a838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:44.244413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157a695-4c5c-46f8-99cc-00b691e95e9d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.250904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bb2c7-ff75-47b5-a144-9fad4399166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:44.251576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bb2c7-ff75-47b5-a144-9fad4399166d admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.255363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bb2c7-ff75-47b5-a144-9fad4399166d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.255363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bb2c7-ff75-47b5-a144-9fad4399166d admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.255363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bb2c7-ff75-47b5-a144-9fad4399166d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:44.255363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bb2c7-ff75-47b5-a144-9fad4399166d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:44.255741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b06fa1-378e-4cad-af2e-ec5ce84a838c None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.257926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bb2c7-ff75-47b5-a144-9fad4399166d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:44.261388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:44.274530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1062/2118] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:44.278762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:44.279458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.279739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.280787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] PATH_INFO: `/v3/projects/b3c059d4a2fa4fb190f6e0007e6d1a8a` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.282626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bb2c7-ff75-47b5-a144-9fad4399166d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.284282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c059d4a2fa4fb190f6e0007e6d1a8a)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:44.286975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:44.295141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bb2c7-ff75-47b5-a144-9fad4399166d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.301003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c6aa3-baa9-4fd6-b037-894d498e96bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:44.302414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c6aa3-baa9-4fd6-b037-894d498e96bd admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.302900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c6aa3-baa9-4fd6-b037-894d498e96bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.303253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c6aa3-baa9-4fd6-b037-894d498e96bd admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.304019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c6aa3-baa9-4fd6-b037-894d498e96bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:44.306022 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c6aa3-baa9-4fd6-b037-894d498e96bd admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:44.450334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c059d4a2fa4fb190f6e0007e6d1a8a', 'request_id': 'req-cf4a793d-adf6-4ac6-800b-bd403035cf30'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:44.456728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c059d4a2fa4fb190f6e0007e6d1a8a', 'request_id': 'req-cf4a793d-adf6-4ac6-800b-bd403035cf30'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:44.465290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c059d4a2fa4fb190f6e0007e6d1a8a', 'request_id': 'req-cf4a793d-adf6-4ac6-800b-bd403035cf30'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:44.466051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1063/2119] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:44 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:44.470532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c6aa3-baa9-4fd6-b037-894d498e96bd admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.544348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c6aa3-baa9-4fd6-b037-894d498e96bd admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.549650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96017e4-00e5-4e6a-b2fe-d6bb48953925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:44.550522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96017e4-00e5-4e6a-b2fe-d6bb48953925 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.550804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96017e4-00e5-4e6a-b2fe-d6bb48953925 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.551080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96017e4-00e5-4e6a-b2fe-d6bb48953925 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.552403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96017e4-00e5-4e6a-b2fe-d6bb48953925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:44.554555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96017e4-00e5-4e6a-b2fe-d6bb48953925 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:44.586960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] The token cache is being invalidate because project b3c059d4a2fa4fb190f6e0007e6d1a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:44.587636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:44.588336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-cf4a793d-adf6-4ac6-800b-bd403035cf30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:44.589912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1057/2120] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:44 2022] DELETE /identity/v3/projects/b3c059d4a2fa4fb190f6e0007e6d1a8a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:44.595675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d508-4320-4363-bd56-1a5b3df99754 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.595955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d508-4320-4363-bd56-1a5b3df99754 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.596227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883d508-4320-4363-bd56-1a5b3df99754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.618484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4883d508-4320-4363-bd56-1a5b3df99754 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:44.619915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4883d508-4320-4363-bd56-1a5b3df99754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:44.636456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1058/2121] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:44.638085 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9181aa7-ca09-4f4f-9948-5f4c6cf07ed3 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.638386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9181aa7-ca09-4f4f-9948-5f4c6cf07ed3 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.638662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9181aa7-ca09-4f4f-9948-5f4c6cf07ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.658927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e9181aa7-ca09-4f4f-9948-5f4c6cf07ed3 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:44.660192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e9181aa7-ca09-4f4f-9948-5f4c6cf07ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:44.669089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1059/2122] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:44.673308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9181aa7-ca09-4f4f-9948-5f4c6cf07ed3 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.684597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9181aa7-ca09-4f4f-9948-5f4c6cf07ed3 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.691737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece8757-8d65-489a-b079-0b9e7841e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:44.692612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece8757-8d65-489a-b079-0b9e7841e025 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.703089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece8757-8d65-489a-b079-0b9e7841e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.703089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece8757-8d65-489a-b079-0b9e7841e025 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.703089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece8757-8d65-489a-b079-0b9e7841e025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:44.703089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece8757-8d65-489a-b079-0b9e7841e025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:44.703089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece8757-8d65-489a-b079-0b9e7841e025 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:44.703764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1064/2123] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:44 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:44.703931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96017e4-00e5-4e6a-b2fe-d6bb48953925 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.705689 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d96017e4-00e5-4e6a-b2fe-d6bb48953925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:44.718721 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1060/2124] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:00:44.719603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96017e4-00e5-4e6a-b2fe-d6bb48953925 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.719943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece8757-8d65-489a-b079-0b9e7841e025 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.737895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe003f-be5d-4179-a39d-17c8569de9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:44.737895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe003f-be5d-4179-a39d-17c8569de9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.737895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe003f-be5d-4179-a39d-17c8569de9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.737895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe003f-be5d-4179-a39d-17c8569de9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.738310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe003f-be5d-4179-a39d-17c8569de9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:44.738310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe003f-be5d-4179-a39d-17c8569de9f9 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:44.738454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece8757-8d65-489a-b079-0b9e7841e025 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.742139 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fabbe-5d73-4a1a-aab6-cda4e5607c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:44.742752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fabbe-5d73-4a1a-aab6-cda4e5607c27 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.743028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fabbe-5d73-4a1a-aab6-cda4e5607c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.743319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fabbe-5d73-4a1a-aab6-cda4e5607c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.743946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fabbe-5d73-4a1a-aab6-cda4e5607c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:44.746678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fabbe-5d73-4a1a-aab6-cda4e5607c27 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:44.748166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1065/2125] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:44.752452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe003f-be5d-4179-a39d-17c8569de9f9 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.762641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe003f-be5d-4179-a39d-17c8569de9f9 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.767343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982edea-b125-40e0-8fb2-9852e8560b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:44.767960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982edea-b125-40e0-8fb2-9852e8560b5b admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.768241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982edea-b125-40e0-8fb2-9852e8560b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.768512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982edea-b125-40e0-8fb2-9852e8560b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.769185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982edea-b125-40e0-8fb2-9852e8560b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:44.771403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982edea-b125-40e0-8fb2-9852e8560b5b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:44.782883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1066/2126] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:44.788144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982edea-b125-40e0-8fb2-9852e8560b5b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.798243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982edea-b125-40e0-8fb2-9852e8560b5b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.803641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf88bb6-61a1-4ce7-9fd2-a16fbe278c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:44.804317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88bb6-61a1-4ce7-9fd2-a16fbe278c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.804600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88bb6-61a1-4ce7-9fd2-a16fbe278c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.804875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88bb6-61a1-4ce7-9fd2-a16fbe278c4d admin admin] PATH_INFO: `/v3/projects/e4214c140e82416d9849f1d5b6deda89/users/4731b14a3b274ab3ad97cd8cd05aeede/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.820883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf88bb6-61a1-4ce7-9fd2-a16fbe278c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4214c140e82416d9849f1d5b6deda89, user_id=4731b14a3b274ab3ad97cd8cd05aeede, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:44.823741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf88bb6-61a1-4ce7-9fd2-a16fbe278c4d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:44.863297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1061/2127] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:44 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:44.866761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fabbe-5d73-4a1a-aab6-cda4e5607c27 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:44.914082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1067/2128] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:44 2022] PUT /identity/v3/projects/e4214c140e82416d9849f1d5b6deda89/users/4731b14a3b274ab3ad97cd8cd05aeede/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:44.943241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852155b4-6166-4c36-86d5-ed1623b51e34 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:44.943665 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852155b4-6166-4c36-86d5-ed1623b51e34 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:44.943943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852155b4-6166-4c36-86d5-ed1623b51e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:44.947356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fabbe-5d73-4a1a-aab6-cda4e5607c27 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:44.980260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-852155b4-6166-4c36-86d5-ed1623b51e34 None None] MFA Rules not processed for user `4731b14a3b274ab3ad97cd8cd05aeede`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:44.981601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-852155b4-6166-4c36-86d5-ed1623b51e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:45.010214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93fb7d-426d-4421-aaac-f3f4470912e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.011099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93fb7d-426d-4421-aaac-f3f4470912e6 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.011574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93fb7d-426d-4421-aaac-f3f4470912e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.011851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93fb7d-426d-4421-aaac-f3f4470912e6 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.012545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93fb7d-426d-4421-aaac-f3f4470912e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.014818 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93fb7d-426d-4421-aaac-f3f4470912e6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.055734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1068/2129] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:45.065110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852155b4-6166-4c36-86d5-ed1623b51e34 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.080410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852155b4-6166-4c36-86d5-ed1623b51e34 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.086609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a89f8-33d1-4c64-88db-017401f9f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.087315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a89f8-33d1-4c64-88db-017401f9f38d admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.091807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a89f8-33d1-4c64-88db-017401f9f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.091807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a89f8-33d1-4c64-88db-017401f9f38d admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.091807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a89f8-33d1-4c64-88db-017401f9f38d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.091807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a89f8-33d1-4c64-88db-017401f9f38d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.121157 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1062/2130] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:44 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:45.122420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93fb7d-426d-4421-aaac-f3f4470912e6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.140461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93fb7d-426d-4421-aaac-f3f4470912e6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.146124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263013f-3697-4e70-ad4a-cd4c555631d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.149173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263013f-3697-4e70-ad4a-cd4c555631d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.149173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263013f-3697-4e70-ad4a-cd4c555631d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.149173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263013f-3697-4e70-ad4a-cd4c555631d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.149173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263013f-3697-4e70-ad4a-cd4c555631d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.150378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263013f-3697-4e70-ad4a-cd4c555631d5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.161574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1063/2131] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:45.165469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263013f-3697-4e70-ad4a-cd4c555631d5 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.180521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263013f-3697-4e70-ad4a-cd4c555631d5 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.185353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7dac4-4fbf-46de-b964-bfeaae2759c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.186008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7dac4-4fbf-46de-b964-bfeaae2759c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.186284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7dac4-4fbf-46de-b964-bfeaae2759c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.186555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7dac4-4fbf-46de-b964-bfeaae2759c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.187200 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7dac4-4fbf-46de-b964-bfeaae2759c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.188883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7dac4-4fbf-46de-b964-bfeaae2759c7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.200541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1064/2132] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:45.204681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7dac4-4fbf-46de-b964-bfeaae2759c7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.206605 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1069/2133] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:45 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:45.211061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a89f8-33d1-4c64-88db-017401f9f38d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.216020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7dac4-4fbf-46de-b964-bfeaae2759c7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.292920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a89f8-33d1-4c64-88db-017401f9f38d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.293431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddd91c-d70e-47aa-b243-62b5e55e4c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.294322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddd91c-d70e-47aa-b243-62b5e55e4c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.294592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddd91c-d70e-47aa-b243-62b5e55e4c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.295054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddd91c-d70e-47aa-b243-62b5e55e4c02 admin admin] PATH_INFO: `/v3/projects/df9ad996673743b28ce7729652377eee/users/5a0d5a9bd01547af9b5546a237f94b5f/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.299212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e82012-dc5f-493f-9fc4-38606bcafe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.300139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e82012-dc5f-493f-9fc4-38606bcafe99 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.300486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e82012-dc5f-493f-9fc4-38606bcafe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.300825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e82012-dc5f-493f-9fc4-38606bcafe99 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.301653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e82012-dc5f-493f-9fc4-38606bcafe99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.303883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e82012-dc5f-493f-9fc4-38606bcafe99 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.315320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddd91c-d70e-47aa-b243-62b5e55e4c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9ad996673743b28ce7729652377eee, user_id=5a0d5a9bd01547af9b5546a237f94b5f, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.319572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddd91c-d70e-47aa-b243-62b5e55e4c02 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.387107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:45.420781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1065/2134] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:45 2022] PUT /identity/v3/projects/df9ad996673743b28ce7729652377eee/users/5a0d5a9bd01547af9b5546a237f94b5f/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:45.420888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1070/2135] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:45 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:45.424504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddd91c-d70e-47aa-b243-62b5e55e4c02 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.430953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca7708-32eb-4f20-b96f-0b1d2e4ad57d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.431499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca7708-32eb-4f20-b96f-0b1d2e4ad57d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.431991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca7708-32eb-4f20-b96f-0b1d2e4ad57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.472733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0fca7708-32eb-4f20-b96f-0b1d2e4ad57d None None] MFA Rules not processed for user `5a0d5a9bd01547af9b5546a237f94b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:45.474174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0fca7708-32eb-4f20-b96f-0b1d2e4ad57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:45.511994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddd91c-d70e-47aa-b243-62b5e55e4c02 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.516696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d59f71-af47-4b96-82c6-d8cf1bd9cef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.517305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d59f71-af47-4b96-82c6-d8cf1bd9cef8 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.517584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d59f71-af47-4b96-82c6-d8cf1bd9cef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.517851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d59f71-af47-4b96-82c6-d8cf1bd9cef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.518495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d59f71-af47-4b96-82c6-d8cf1bd9cef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.520386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d59f71-af47-4b96-82c6-d8cf1bd9cef8 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.531277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1066/2136] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:45.535974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d59f71-af47-4b96-82c6-d8cf1bd9cef8 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.555380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d59f71-af47-4b96-82c6-d8cf1bd9cef8 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.555584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1071/2137] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:45.558819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca7708-32eb-4f20-b96f-0b1d2e4ad57d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.563992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe2a24-26dc-4b7d-bccb-f06a887401eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.564933 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe2a24-26dc-4b7d-bccb-f06a887401eb admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.565281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe2a24-26dc-4b7d-bccb-f06a887401eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.565663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe2a24-26dc-4b7d-bccb-f06a887401eb admin admin] PATH_INFO: `/v3/projects/7237826991814266aadde473b857c5e8/users/c9997717eee546739e3380c4010af96e/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.578978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca7708-32eb-4f20-b96f-0b1d2e4ad57d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.583760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe2a24-26dc-4b7d-bccb-f06a887401eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7237826991814266aadde473b857c5e8, user_id=c9997717eee546739e3380c4010af96e, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.586404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99318bef-2a22-4bbc-8664-ee752c785ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.586671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe2a24-26dc-4b7d-bccb-f06a887401eb admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.587469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99318bef-2a22-4bbc-8664-ee752c785ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.587920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99318bef-2a22-4bbc-8664-ee752c785ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.588416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99318bef-2a22-4bbc-8664-ee752c785ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.589448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99318bef-2a22-4bbc-8664-ee752c785ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.592850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99318bef-2a22-4bbc-8664-ee752c785ac9 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.603096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:45.705869 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1067/2138] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:45 2022] PUT /identity/v3/projects/7237826991814266aadde473b857c5e8/users/c9997717eee546739e3380c4010af96e/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:45.706980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe2a24-26dc-4b7d-bccb-f06a887401eb admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.728805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1072/2139] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:45 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:45.735443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99318bef-2a22-4bbc-8664-ee752c785ac9 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.780264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe2a24-26dc-4b7d-bccb-f06a887401eb admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.813148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99318bef-2a22-4bbc-8664-ee752c785ac9 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.819028 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba68b1d-5de7-455a-b3cc-d5698be183d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.820010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba68b1d-5de7-455a-b3cc-d5698be183d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.820174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba68b1d-5de7-455a-b3cc-d5698be183d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.820501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba68b1d-5de7-455a-b3cc-d5698be183d0 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.821128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba68b1d-5de7-455a-b3cc-d5698be183d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.823158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba68b1d-5de7-455a-b3cc-d5698be183d0 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.852311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d3f50-a349-4573-8bb2-af9a2161f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.856057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d3f50-a349-4573-8bb2-af9a2161f540 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.856057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d3f50-a349-4573-8bb2-af9a2161f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.856057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d3f50-a349-4573-8bb2-af9a2161f540 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.856057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d3f50-a349-4573-8bb2-af9a2161f540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.856057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d3f50-a349-4573-8bb2-af9a2161f540 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.867785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1068/2140] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:45.871851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d3f50-a349-4573-8bb2-af9a2161f540 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.882093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d3f50-a349-4573-8bb2-af9a2161f540 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.886844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf9f7e-b41a-46c1-a213-0ba482325b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:45.887516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9f7e-b41a-46c1-a213-0ba482325b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.887793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9f7e-b41a-46c1-a213-0ba482325b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.888063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf9f7e-b41a-46c1-a213-0ba482325b42 admin admin] PATH_INFO: `/v3/projects/7237826991814266aadde473b857c5e8/users/c9997717eee546739e3380c4010af96e/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.892807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf9f7e-b41a-46c1-a213-0ba482325b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7237826991814266aadde473b857c5e8, user_id=c9997717eee546739e3380c4010af96e, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:45.896393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf9f7e-b41a-46c1-a213-0ba482325b42 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:45.912603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1069/2141] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:45 2022] PUT /identity/v3/projects/7237826991814266aadde473b857c5e8/users/c9997717eee546739e3380c4010af96e/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:45.923297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1073/2142] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:45 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:45.923466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5030-357b-4406-9fe3-c6f3c0b07f1c None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:45.923764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5030-357b-4406-9fe3-c6f3c0b07f1c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:45.924929 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba68b1d-5de7-455a-b3cc-d5698be183d0 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:45.925596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb5030-357b-4406-9fe3-c6f3c0b07f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:45.960686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba68b1d-5de7-455a-b3cc-d5698be183d0 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:45.983709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-68eb5030-357b-4406-9fe3-c6f3c0b07f1c None None] MFA Rules not processed for user `c9997717eee546739e3380c4010af96e`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:45.985567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-68eb5030-357b-4406-9fe3-c6f3c0b07f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:46.045778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfb152-d4d3-409d-8587-c96d262cc69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:46.046394 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfb152-d4d3-409d-8587-c96d262cc69b admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:46.046839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfb152-d4d3-409d-8587-c96d262cc69b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:46.047120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfb152-d4d3-409d-8587-c96d262cc69b admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:46.047808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfb152-d4d3-409d-8587-c96d262cc69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:46.049425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfb152-d4d3-409d-8587-c96d262cc69b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:46.063833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1074/2143] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:46.064918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfb152-d4d3-409d-8587-c96d262cc69b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:46.070401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1070/2144] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:46.076414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfb152-d4d3-409d-8587-c96d262cc69b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:46.081579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9e3da-7c1c-4268-93bc-26cb04f4c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:46.082540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb5030-357b-4406-9fe3-c6f3c0b07f1c None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:46.083359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9e3da-7c1c-4268-93bc-26cb04f4c989 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:46.083359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9e3da-7c1c-4268-93bc-26cb04f4c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:46.083660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9e3da-7c1c-4268-93bc-26cb04f4c989 admin admin] PATH_INFO: `/v3/projects/c7833a9fa3944219be90f71b848fb210/users/05c6b5b4237a4f7d89fb124d0465a811/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:46.084451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-68eb5030-357b-4406-9fe3-c6f3c0b07f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:46.103835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9e3da-7c1c-4268-93bc-26cb04f4c989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7833a9fa3944219be90f71b848fb210, user_id=05c6b5b4237a4f7d89fb124d0465a811, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:46.104970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9e3da-7c1c-4268-93bc-26cb04f4c989 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:46.160596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb5030-357b-4406-9fe3-c6f3c0b07f1c None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:46.165185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d660fc-9ecb-47cd-ad0f-aedbd2bafaef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:46.165387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d660fc-9ecb-47cd-ad0f-aedbd2bafaef service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:46.165630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d660fc-9ecb-47cd-ad0f-aedbd2bafaef service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:46.165909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d660fc-9ecb-47cd-ad0f-aedbd2bafaef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:46.175958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d660fc-9ecb-47cd-ad0f-aedbd2bafaef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:46.178329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d660fc-9ecb-47cd-ad0f-aedbd2bafaef service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:46.189460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1071/2145] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:46.294418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1075/2146] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:46 2022] PUT /identity/v3/projects/c7833a9fa3944219be90f71b848fb210/users/05c6b5b4237a4f7d89fb124d0465a811/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:46.298483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d660fc-9ecb-47cd-ad0f-aedbd2bafaef service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:46.310297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d660fc-9ecb-47cd-ad0f-aedbd2bafaef service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:46.390799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f186bdc-ec2e-4835-9b72-9dfff2a5944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:46.391835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f186bdc-ec2e-4835-9b72-9dfff2a5944e admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:46.392485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f186bdc-ec2e-4835-9b72-9dfff2a5944e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:46.392777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f186bdc-ec2e-4835-9b72-9dfff2a5944e admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:46.393877 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f186bdc-ec2e-4835-9b72-9dfff2a5944e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:46.398145 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f186bdc-ec2e-4835-9b72-9dfff2a5944e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:46.419404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1072/2147] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:46.421388 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9e3da-7c1c-4268-93bc-26cb04f4c989 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:46.433723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9e3da-7c1c-4268-93bc-26cb04f4c989 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:46.437808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:46.439629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159b7a-a4db-46ea-8053-f49c53f5cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:46.440332 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159b7a-a4db-46ea-8053-f49c53f5cae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:46.440766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159b7a-a4db-46ea-8053-f49c53f5cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:46.441067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47159b7a-a4db-46ea-8053-f49c53f5cae1 admin admin] PATH_INFO: `/v3/projects/c7833a9fa3944219be90f71b848fb210/users/05c6b5b4237a4f7d89fb124d0465a811/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:46.443673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47159b7a-a4db-46ea-8053-f49c53f5cae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7833a9fa3944219be90f71b848fb210, user_id=05c6b5b4237a4f7d89fb124d0465a811, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:46.446428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47159b7a-a4db-46ea-8053-f49c53f5cae1 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:46.461632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1076/2148] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:46 2022] PUT /identity/v3/projects/c7833a9fa3944219be90f71b848fb210/users/05c6b5b4237a4f7d89fb124d0465a811/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:46.472937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68612f-0f0d-46d2-a510-7d530c9eba52 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:46.473221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68612f-0f0d-46d2-a510-7d530c9eba52 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:46.473494 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68612f-0f0d-46d2-a510-7d530c9eba52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:46.512024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-bf68612f-0f0d-46d2-a510-7d530c9eba52 None None] MFA Rules not processed for user `05c6b5b4237a4f7d89fb124d0465a811`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:46.513418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bf68612f-0f0d-46d2-a510-7d530c9eba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:46.589504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:46.612867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1073/2149] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:46.635119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159b7a-a4db-46ea-8053-f49c53f5cae1 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:46.641367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-47159b7a-a4db-46ea-8053-f49c53f5cae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:46.727367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47159b7a-a4db-46ea-8053-f49c53f5cae1 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:46.732626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58090c-9da6-43f0-b53f-f020099edae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:46.733248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58090c-9da6-43f0-b53f-f020099edae8 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:46.733530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58090c-9da6-43f0-b53f-f020099edae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:46.733801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58090c-9da6-43f0-b53f-f020099edae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:46.744060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58090c-9da6-43f0-b53f-f020099edae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:46.746304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58090c-9da6-43f0-b53f-f020099edae8 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:46.757819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1077/2150] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:46.830414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68612f-0f0d-46d2-a510-7d530c9eba52 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:46.900550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68612f-0f0d-46d2-a510-7d530c9eba52 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:46.904377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:46.905019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:46.905293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:46.905564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] PATH_INFO: `/v3/users/5a0d5a9bd01547af9b5546a237f94b5f` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:46.907171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0d5a9bd01547af9b5546a237f94b5f)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:46.909167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:46.932092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58090c-9da6-43f0-b53f-f020099edae8 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:46.949090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58090c-9da6-43f0-b53f-f020099edae8 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:46.955757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:46.955757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:46.955757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:46.955757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] PATH_INFO: `/v3/users/4731b14a3b274ab3ad97cd8cd05aeede` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:46.959286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4731b14a3b274ab3ad97cd8cd05aeede)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:46.959975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:47.038170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:47.173409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0d5a9bd01547af9b5546a237f94b5f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.173679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4731b14a3b274ab3ad97cd8cd05aeede'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.174343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4731b14a3b274ab3ad97cd8cd05aeede'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.175207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0d5a9bd01547af9b5546a237f94b5f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.184084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0d5a9bd01547af9b5546a237f94b5f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.275434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4731b14a3b274ab3ad97cd8cd05aeede'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.283695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4731b14a3b274ab3ad97cd8cd05aeede'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.297234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acefa8e-7663-4be6-a1fa-72dbea4b0fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4731b14a3b274ab3ad97cd8cd05aeede'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.304264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1078/2151] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:46 2022] DELETE /identity/v3/users/4731b14a3b274ab3ad97cd8cd05aeede => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:47.308677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90802d77-129c-4665-beb9-83d47192a78b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:47.313970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90802d77-129c-4665-beb9-83d47192a78b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:47.313970 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90802d77-129c-4665-beb9-83d47192a78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:47.328184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-90802d77-129c-4665-beb9-83d47192a78b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:47.329399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-90802d77-129c-4665-beb9-83d47192a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:47.362839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:47.385315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0d5a9bd01547af9b5546a237f94b5f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.390763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1079/2152] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:47.400863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90802d77-129c-4665-beb9-83d47192a78b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:47.402394 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-90802d77-129c-4665-beb9-83d47192a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:47.416294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ec0d03d3-d2f8-4fef-a1a9-76df991dcb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0d5a9bd01547af9b5546a237f94b5f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:47.423172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1074/2153] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:46 2022] DELETE /identity/v3/users/5a0d5a9bd01547af9b5546a237f94b5f => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:47.428813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e600a0-580a-4449-bd11-8ef0677cb19a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:47.429502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e600a0-580a-4449-bd11-8ef0677cb19a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:47.429784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e600a0-580a-4449-bd11-8ef0677cb19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:47.452772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-23e600a0-580a-4449-bd11-8ef0677cb19a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:47.454001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-23e600a0-580a-4449-bd11-8ef0677cb19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:47.475204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90802d77-129c-4665-beb9-83d47192a78b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:47.497977 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:47.540964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ecfbc-7730-4886-a54f-8e4937186448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:47.541644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ecfbc-7730-4886-a54f-8e4937186448 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:47.542031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ecfbc-7730-4886-a54f-8e4937186448 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:47.542307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ecfbc-7730-4886-a54f-8e4937186448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:47.542804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1075/2154] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:47.553117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e600a0-580a-4449-bd11-8ef0677cb19a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:47.553501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ecfbc-7730-4886-a54f-8e4937186448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:47.555211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ecfbc-7730-4886-a54f-8e4937186448 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:47.566704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1080/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:47.566860 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e600a0-580a-4449-bd11-8ef0677cb19a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:47.571443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509071e0-fffc-415a-8c90-98ce338af918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:47.572123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509071e0-fffc-415a-8c90-98ce338af918 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:47.572482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509071e0-fffc-415a-8c90-98ce338af918 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:47.572811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509071e0-fffc-415a-8c90-98ce338af918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:47.592142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509071e0-fffc-415a-8c90-98ce338af918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:47.595040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509071e0-fffc-415a-8c90-98ce338af918 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:47.611454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1076/2156] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:00:48.055049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:48.153855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ecfbc-7730-4886-a54f-8e4937186448 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:48.153855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cf2ecfbc-7730-4886-a54f-8e4937186448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:48.162492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ecfbc-7730-4886-a54f-8e4937186448 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:48.168299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:48.169360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:48.169918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:48.171600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:48.177003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] PATH_INFO: `/v3/projects/e4214c140e82416d9849f1d5b6deda89` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:48.177003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4214c140e82416d9849f1d5b6deda89)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:48.178741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509071e0-fffc-415a-8c90-98ce338af918 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:48.179955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-509071e0-fffc-415a-8c90-98ce338af918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:48.184529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:48.211902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509071e0-fffc-415a-8c90-98ce338af918 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:48.221310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:48.221891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:48.226555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:48.226555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] PATH_INFO: `/v3/projects/df9ad996673743b28ce7729652377eee` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:48.226555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9ad996673743b28ce7729652377eee)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:48.226555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:48.321025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4214c140e82416d9849f1d5b6deda89', 'request_id': 'req-dc49a04f-55df-4715-8596-9960d7bc09e7'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.328247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4214c140e82416d9849f1d5b6deda89', 'request_id': 'req-dc49a04f-55df-4715-8596-9960d7bc09e7'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.371078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9ad996673743b28ce7729652377eee', 'request_id': 'req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.377010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9ad996673743b28ce7729652377eee', 'request_id': 'req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.383507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9ad996673743b28ce7729652377eee', 'request_id': 'req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.431715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4214c140e82416d9849f1d5b6deda89', 'request_id': 'req-dc49a04f-55df-4715-8596-9960d7bc09e7'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.447071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] The token cache is being invalidate because project e4214c140e82416d9849f1d5b6deda89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:48.447401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.448132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.450262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1081/2157] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:48 2022] DELETE /identity/v3/projects/e4214c140e82416d9849f1d5b6deda89 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:48.454016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:48.455525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:48.524920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49a04f-55df-4715-8596-9960d7bc09e7 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:48.527477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] The token cache is being invalidate because project df9ad996673743b28ce7729652377eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:48.527852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.528594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.530358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1077/2158] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:48 2022] DELETE /identity/v3/projects/df9ad996673743b28ce7729652377eee => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:48.534768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:48.536462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:48.623821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:48.624506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28263a03-1f9f-4d5d-a3d1-fcc0281b20ec admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:48.624631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:48.624948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:48.625329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] PATH_INFO: `/v3/users/c9997717eee546739e3380c4010af96e` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:48.626528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9997717eee546739e3380c4010af96e)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:48.628614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:48.629307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:48.629934 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:48.630211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:48.630540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] PATH_INFO: `/v3/users/05c6b5b4237a4f7d89fb124d0465a811` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:48.631745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c6b5b4237a4f7d89fb124d0465a811)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:48.633673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:48.889059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9997717eee546739e3380c4010af96e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.889528 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c6b5b4237a4f7d89fb124d0465a811'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.889928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9997717eee546739e3380c4010af96e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.890180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c6b5b4237a4f7d89fb124d0465a811'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.901586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c6b5b4237a4f7d89fb124d0465a811'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.940428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:48.957271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9997717eee546739e3380c4010af96e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.966715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9997717eee546739e3380c4010af96e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.986131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9997717eee546739e3380c4010af96e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:48.997343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1082/2159] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:48 2022] DELETE /identity/v3/users/c9997717eee546739e3380c4010af96e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:49.038277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c6b5b4237a4f7d89fb124d0465a811'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:49.054906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c6b5b4237a4f7d89fb124d0465a811'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:49.067217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1078/2160] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:48 2022] DELETE /identity/v3/users/05c6b5b4237a4f7d89fb124d0465a811 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:49.077382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:49.513080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:49.648298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:49.649380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:49.650704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:49.676467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:49.680335 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:49.770225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16602ac-4e65-4493-81f6-c85e30ee3447 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:49.788162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411efb4-44f1-4344-99d7-2a941aafdde1 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:49.793351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:49.794287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:49.794575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:49.794947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] PATH_INFO: `/v3/projects/7237826991814266aadde473b857c5e8` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:49.796236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7237826991814266aadde473b857c5e8)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:49.798455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:49.852264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:49.853193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:49.853470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:49.853741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] PATH_INFO: `/v3/projects/c7833a9fa3944219be90f71b848fb210` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:49.854906 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7833a9fa3944219be90f71b848fb210)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:49.857104 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:49.972574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7237826991814266aadde473b857c5e8', 'request_id': 'req-6f6fa55d-ff42-4206-9e88-41cf6caccccf'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:49.990986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7833a9fa3944219be90f71b848fb210', 'request_id': 'req-4753f563-b15b-45e8-9f58-535a065346cb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:49.991734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7237826991814266aadde473b857c5e8', 'request_id': 'req-6f6fa55d-ff42-4206-9e88-41cf6caccccf'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:49.999355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7237826991814266aadde473b857c5e8', 'request_id': 'req-6f6fa55d-ff42-4206-9e88-41cf6caccccf'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:50.001690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7833a9fa3944219be90f71b848fb210', 'request_id': 'req-4753f563-b15b-45e8-9f58-535a065346cb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:50.031994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:50.094768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] The token cache is being invalidate because project 7237826991814266aadde473b857c5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:50.095128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:50.095775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f6fa55d-ff42-4206-9e88-41cf6caccccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:50.097295 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1079/2161] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:49 2022] DELETE /identity/v3/projects/7237826991814266aadde473b857c5e8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:50.102205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cccfc-5793-4fe3-8a6e-f204d35cfb9d None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.102491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cccfc-5793-4fe3-8a6e-f204d35cfb9d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.102891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cccfc-5793-4fe3-8a6e-f204d35cfb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.125724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0a9cccfc-5793-4fe3-8a6e-f204d35cfb9d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:50.126951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0a9cccfc-5793-4fe3-8a6e-f204d35cfb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:50.196607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1080/2162] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:50.205326 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48e67-a908-4aeb-94a5-7d52e9db20dd None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.205611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48e67-a908-4aeb-94a5-7d52e9db20dd None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.205886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48e67-a908-4aeb-94a5-7d52e9db20dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.223755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7833a9fa3944219be90f71b848fb210', 'request_id': 'req-4753f563-b15b-45e8-9f58-535a065346cb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:50.227067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8df48e67-a908-4aeb-94a5-7d52e9db20dd None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:50.228333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8df48e67-a908-4aeb-94a5-7d52e9db20dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:50.236136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] The token cache is being invalidate because project c7833a9fa3944219be90f71b848fb210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:50.237106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:50.237292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:50.239761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1083/2163] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:49 2022] DELETE /identity/v3/projects/c7833a9fa3944219be90f71b848fb210 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:50.241784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1081/2164] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:50.242500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.244908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:50.247574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60a76-8d31-4db1-8cab-cc65294be365 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.248089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60a76-8d31-4db1-8cab-cc65294be365 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.248573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d60a76-8d31-4db1-8cab-cc65294be365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.260330 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753f563-b15b-45e8-9f58-535a065346cb admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.265988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925309d-0afe-49f8-9658-746c613ed8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.266609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925309d-0afe-49f8-9658-746c613ed8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.266881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925309d-0afe-49f8-9658-746c613ed8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.267149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925309d-0afe-49f8-9658-746c613ed8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.267855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925309d-0afe-49f8-9658-746c613ed8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:50.268158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925309d-0afe-49f8-9658-746c613ed8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.269921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925309d-0afe-49f8-9658-746c613ed8f9 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.279002 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-02d60a76-8d31-4db1-8cab-cc65294be365 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:50.280543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-02d60a76-8d31-4db1-8cab-cc65294be365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:50.282393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1084/2165] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:50.287452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925309d-0afe-49f8-9658-746c613ed8f9 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.290663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1082/2166] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:50.299661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925309d-0afe-49f8-9658-746c613ed8f9 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.301473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5ca08-48e7-446e-9154-d68c60a832e0 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.301473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5ca08-48e7-446e-9154-d68c60a832e0 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.301687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5ca08-48e7-446e-9154-d68c60a832e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.305944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da246-c040-4d77-906a-12462d8f646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.307309 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da246-c040-4d77-906a-12462d8f646b admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.307309 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da246-c040-4d77-906a-12462d8f646b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.307309 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da246-c040-4d77-906a-12462d8f646b admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.307802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11da246-c040-4d77-906a-12462d8f646b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.309736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11da246-c040-4d77-906a-12462d8f646b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.329097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e8b5ca08-48e7-446e-9154-d68c60a832e0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:50.330282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e8b5ca08-48e7-446e-9154-d68c60a832e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:50.351180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1083/2167] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:50.356664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5ca08-48e7-446e-9154-d68c60a832e0 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.369566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5ca08-48e7-446e-9154-d68c60a832e0 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.381877 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357f60a-586d-45e3-9c6d-93718e75de97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.383086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357f60a-586d-45e3-9c6d-93718e75de97 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.383553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357f60a-586d-45e3-9c6d-93718e75de97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.384100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357f60a-586d-45e3-9c6d-93718e75de97 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.384790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357f60a-586d-45e3-9c6d-93718e75de97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:50.385100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357f60a-586d-45e3-9c6d-93718e75de97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.386741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357f60a-586d-45e3-9c6d-93718e75de97 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.403500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1084/2168] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:50.407743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357f60a-586d-45e3-9c6d-93718e75de97 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.420834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357f60a-586d-45e3-9c6d-93718e75de97 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.425652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cf2dd-887c-450a-a2eb-39485dad4354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.426259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf2dd-887c-450a-a2eb-39485dad4354 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.426625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf2dd-887c-450a-a2eb-39485dad4354 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.426899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cf2dd-887c-450a-a2eb-39485dad4354 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.427646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cf2dd-887c-450a-a2eb-39485dad4354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.429931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cf2dd-887c-450a-a2eb-39485dad4354 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.456551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1085/2169] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:50.457833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da246-c040-4d77-906a-12462d8f646b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.507176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:50.553345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da246-c040-4d77-906a-12462d8f646b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.559211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1085/2170] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:50.559384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b84d-7ea4-4177-be10-87eeb8efa42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.559384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b84d-7ea4-4177-be10-87eeb8efa42c admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.559594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b84d-7ea4-4177-be10-87eeb8efa42c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.559824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b84d-7ea4-4177-be10-87eeb8efa42c admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.560247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cf2dd-887c-450a-a2eb-39485dad4354 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.560462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86b84d-7ea4-4177-be10-87eeb8efa42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.562426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86b84d-7ea4-4177-be10-87eeb8efa42c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.631423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cf2dd-887c-450a-a2eb-39485dad4354 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.636286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c3c8e-829a-4e12-9f31-c2a2a5e0d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.636888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3c8e-829a-4e12-9f31-c2a2a5e0d6bd admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.637166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3c8e-829a-4e12-9f31-c2a2a5e0d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.637464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3c8e-829a-4e12-9f31-c2a2a5e0d6bd admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.638175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c3c8e-829a-4e12-9f31-c2a2a5e0d6bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.640026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c3c8e-829a-4e12-9f31-c2a2a5e0d6bd admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.681116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1086/2171] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:50.685427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b84d-7ea4-4177-be10-87eeb8efa42c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.696666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b84d-7ea4-4177-be10-87eeb8efa42c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.701644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470d1f1-7a8b-41da-88fa-fc9332417953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.706435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470d1f1-7a8b-41da-88fa-fc9332417953 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.706435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470d1f1-7a8b-41da-88fa-fc9332417953 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.706435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470d1f1-7a8b-41da-88fa-fc9332417953 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.706435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470d1f1-7a8b-41da-88fa-fc9332417953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.706435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470d1f1-7a8b-41da-88fa-fc9332417953 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.716691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1087/2172] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:50.720864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470d1f1-7a8b-41da-88fa-fc9332417953 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.731848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470d1f1-7a8b-41da-88fa-fc9332417953 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.738544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27544738-55c3-4867-9f17-17e0f8c0b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.742303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27544738-55c3-4867-9f17-17e0f8c0b790 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.742303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27544738-55c3-4867-9f17-17e0f8c0b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.742303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27544738-55c3-4867-9f17-17e0f8c0b790 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.742303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27544738-55c3-4867-9f17-17e0f8c0b790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.743324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27544738-55c3-4867-9f17-17e0f8c0b790 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.759911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1088/2173] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:50.764264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27544738-55c3-4867-9f17-17e0f8c0b790 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.774701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27544738-55c3-4867-9f17-17e0f8c0b790 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.781068 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1086/2174] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:50.782310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf987b-0dd2-45c6-8555-f3977469c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.782310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf987b-0dd2-45c6-8555-f3977469c0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.782310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf987b-0dd2-45c6-8555-f3977469c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.782310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf987b-0dd2-45c6-8555-f3977469c0a0 admin admin] PATH_INFO: `/v3/projects/16aabddcd6d943008d838c7990011c15/users/638505c8b58740bfb4e89a6021ec58cc/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.782986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c3c8e-829a-4e12-9f31-c2a2a5e0d6bd admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.794211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c3c8e-829a-4e12-9f31-c2a2a5e0d6bd admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.799121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c179a6d-2068-4693-b611-6bfd5a5c8737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.799784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c179a6d-2068-4693-b611-6bfd5a5c8737 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.800067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c179a6d-2068-4693-b611-6bfd5a5c8737 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.800337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c179a6d-2068-4693-b611-6bfd5a5c8737 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.802056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c179a6d-2068-4693-b611-6bfd5a5c8737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.804301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c179a6d-2068-4693-b611-6bfd5a5c8737 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.807734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf987b-0dd2-45c6-8555-f3977469c0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16aabddcd6d943008d838c7990011c15, user_id=638505c8b58740bfb4e89a6021ec58cc, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.810491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf987b-0dd2-45c6-8555-f3977469c0a0 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.815525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1087/2175] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:50.822287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c179a6d-2068-4693-b611-6bfd5a5c8737 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.836478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c179a6d-2068-4693-b611-6bfd5a5c8737 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.841502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf885e3a-d62f-48fb-8692-2a259cb48ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.842110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885e3a-d62f-48fb-8692-2a259cb48ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.842392 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885e3a-d62f-48fb-8692-2a259cb48ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.842665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885e3a-d62f-48fb-8692-2a259cb48ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.843347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf885e3a-d62f-48fb-8692-2a259cb48ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.845014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf885e3a-d62f-48fb-8692-2a259cb48ae9 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.856226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1088/2176] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:50.861144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf885e3a-d62f-48fb-8692-2a259cb48ae9 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:50.872391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf885e3a-d62f-48fb-8692-2a259cb48ae9 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:50.877723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d512334-17b3-4086-b520-4ab8ca11933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:50.878273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d512334-17b3-4086-b520-4ab8ca11933d admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.878561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d512334-17b3-4086-b520-4ab8ca11933d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.878930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d512334-17b3-4086-b520-4ab8ca11933d admin admin] PATH_INFO: `/v3/projects/bcd44de0eb894dd29839da14252cd079/users/dcbfe7d69cdb4d27a63b347a3385bc48/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.881254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1089/2177] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:50 2022] PUT /identity/v3/projects/16aabddcd6d943008d838c7990011c15/users/638505c8b58740bfb4e89a6021ec58cc/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:50.892149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf6312-155d-4a49-8203-ec9ee41b04ca None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:50.892534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf6312-155d-4a49-8203-ec9ee41b04ca None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:50.892838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf6312-155d-4a49-8203-ec9ee41b04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:50.897049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d512334-17b3-4086-b520-4ab8ca11933d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd44de0eb894dd29839da14252cd079, user_id=dcbfe7d69cdb4d27a63b347a3385bc48, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:50.900553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d512334-17b3-4086-b520-4ab8ca11933d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:50.922505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-9dbf6312-155d-4a49-8203-ec9ee41b04ca None None] MFA Rules not processed for user `638505c8b58740bfb4e89a6021ec58cc`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:50.923768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9dbf6312-155d-4a49-8203-ec9ee41b04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:50.989565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1089/2178] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:50 2022] PUT /identity/v3/projects/bcd44de0eb894dd29839da14252cd079/users/dcbfe7d69cdb4d27a63b347a3385bc48/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:50.998385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1090/2179] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:51.000931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6a320-ed23-481f-8497-cbfa0c61a6b2 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:51.001238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6a320-ed23-481f-8497-cbfa0c61a6b2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:51.001574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6a320-ed23-481f-8497-cbfa0c61a6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:51.010753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf6312-155d-4a49-8203-ec9ee41b04ca None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:51.012607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9dbf6312-155d-4a49-8203-ec9ee41b04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:51.030920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-62b6a320-ed23-481f-8497-cbfa0c61a6b2 None None] MFA Rules not processed for user `dcbfe7d69cdb4d27a63b347a3385bc48`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:51.032248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-62b6a320-ed23-481f-8497-cbfa0c61a6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:51.080641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:51.084501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf6312-155d-4a49-8203-ec9ee41b04ca None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:51.116216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1090/2180] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:51.120699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6a320-ed23-481f-8497-cbfa0c61a6b2 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:51.156477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5649749-4d7b-461d-beba-559967902c0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4414630bb2da4523906f0b2dee0c4c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:51.157948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5649749-4d7b-461d-beba-559967902c0b service glance] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:51.159045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5649749-4d7b-461d-beba-559967902c0b service glance] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:51.160269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5649749-4d7b-461d-beba-559967902c0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:51.174680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:51.202524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6a320-ed23-481f-8497-cbfa0c61a6b2 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:51.207553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bc24f-96c6-44ff-a468-41926665df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:51.208170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bc24f-96c6-44ff-a468-41926665df13 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:51.208450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bc24f-96c6-44ff-a468-41926665df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:51.209280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bc24f-96c6-44ff-a468-41926665df13 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:51.210320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bc24f-96c6-44ff-a468-41926665df13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:51.212406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bc24f-96c6-44ff-a468-41926665df13 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:51.232798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5649749-4d7b-461d-beba-559967902c0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:51.234279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5649749-4d7b-461d-beba-559967902c0b service glance] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:51.245570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1091/2181] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:51.308066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1091/2182] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:51 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:51.309870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5649749-4d7b-461d-beba-559967902c0b service glance] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:51.327271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5649749-4d7b-461d-beba-559967902c0b service glance] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:51.401172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43c10-d0e6-48e4-bf34-2b306c4c9712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:51.401786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43c10-d0e6-48e4-bf34-2b306c4c9712 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:51.402065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43c10-d0e6-48e4-bf34-2b306c4c9712 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:51.402335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43c10-d0e6-48e4-bf34-2b306c4c9712 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:51.402964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43c10-d0e6-48e4-bf34-2b306c4c9712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:51.404964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43c10-d0e6-48e4-bf34-2b306c4c9712 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:51.449250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:51.497690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1092/2183] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:51 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:51.501683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bc24f-96c6-44ff-a468-41926665df13 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:51.519916 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:51.525010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bc24f-96c6-44ff-a468-41926665df13 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:51.530259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3275e7-0ca5-4553-ba5d-4168e8574652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:51.530885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3275e7-0ca5-4553-ba5d-4168e8574652 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:51.531341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3275e7-0ca5-4553-ba5d-4168e8574652 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:51.531620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3275e7-0ca5-4553-ba5d-4168e8574652 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:51.532668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3275e7-0ca5-4553-ba5d-4168e8574652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:51.534710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3275e7-0ca5-4553-ba5d-4168e8574652 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:51.554367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1092/2184] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:51.554678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:51.556383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43c10-d0e6-48e4-bf34-2b306c4c9712 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:51.574693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43c10-d0e6-48e4-bf34-2b306c4c9712 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:51.587859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa1428-67c9-4a3a-895d-963b87c34112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:51.588724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa1428-67c9-4a3a-895d-963b87c34112 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:51.589021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa1428-67c9-4a3a-895d-963b87c34112 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:51.589297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa1428-67c9-4a3a-895d-963b87c34112 admin admin] PATH_INFO: `/v3/projects/7458d8b67500497fb1d484cd959974e4/users/4c3387a72b6d4db8a39491a82be189b4/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:51.609243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa1428-67c9-4a3a-895d-963b87c34112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7458d8b67500497fb1d484cd959974e4, user_id=4c3387a72b6d4db8a39491a82be189b4, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:51.615991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa1428-67c9-4a3a-895d-963b87c34112 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:51.705246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1093/2185] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:51 2022] PUT /identity/v3/projects/7458d8b67500497fb1d484cd959974e4/users/4c3387a72b6d4db8a39491a82be189b4/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:51.710069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3275e7-0ca5-4553-ba5d-4168e8574652 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:51.722359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3275e7-0ca5-4553-ba5d-4168e8574652 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:51.789017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1d121-778a-47e6-8231-a14a8ed60740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:51.797926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d121-778a-47e6-8231-a14a8ed60740 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:51.797926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d121-778a-47e6-8231-a14a8ed60740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:51.797926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1d121-778a-47e6-8231-a14a8ed60740 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:51.797926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d121-778a-47e6-8231-a14a8ed60740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:51.797926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1d121-778a-47e6-8231-a14a8ed60740 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:51.807142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1093/2186] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:00:51.808373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa1428-67c9-4a3a-895d-963b87c34112 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:51.819981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa1428-67c9-4a3a-895d-963b87c34112 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:51.828315 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b49a0-dba3-49ef-99dd-923a5d8a0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:51.829029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b49a0-dba3-49ef-99dd-923a5d8a0c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:51.829321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b49a0-dba3-49ef-99dd-923a5d8a0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:51.830966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b49a0-dba3-49ef-99dd-923a5d8a0c03 admin admin] PATH_INFO: `/v3/projects/7458d8b67500497fb1d484cd959974e4/users/4c3387a72b6d4db8a39491a82be189b4/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:51.833490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b49a0-dba3-49ef-99dd-923a5d8a0c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7458d8b67500497fb1d484cd959974e4, user_id=4c3387a72b6d4db8a39491a82be189b4, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:51.836779 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b49a0-dba3-49ef-99dd-923a5d8a0c03 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:51.850241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1094/2187] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:51 2022] PUT /identity/v3/projects/7458d8b67500497fb1d484cd959974e4/users/4c3387a72b6d4db8a39491a82be189b4/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:51.862288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db461fd-43c1-4913-901e-6455c72cc65b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:51.862601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db461fd-43c1-4913-901e-6455c72cc65b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:51.862874 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db461fd-43c1-4913-901e-6455c72cc65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:51.894537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7db461fd-43c1-4913-901e-6455c72cc65b None None] MFA Rules not processed for user `4c3387a72b6d4db8a39491a82be189b4`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:51.895948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7db461fd-43c1-4913-901e-6455c72cc65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:51.985968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1094/2188] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:51.997500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b49a0-dba3-49ef-99dd-923a5d8a0c03 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:51.999297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-821b49a0-dba3-49ef-99dd-923a5d8a0c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:52.067004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b49a0-dba3-49ef-99dd-923a5d8a0c03 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:52.071700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ee6f0-158f-4d62-ab4f-f806d3c29d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:52.072458 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee6f0-158f-4d62-ab4f-f806d3c29d34 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:52.072592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee6f0-158f-4d62-ab4f-f806d3c29d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:52.072860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ee6f0-158f-4d62-ab4f-f806d3c29d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:52.082592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ee6f0-158f-4d62-ab4f-f806d3c29d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:52.084644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ee6f0-158f-4d62-ab4f-f806d3c29d34 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:52.094566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1095/2189] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:52.172566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:52.245039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:53.494540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:53.675354 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db461fd-43c1-4913-901e-6455c72cc65b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:53.749106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db461fd-43c1-4913-901e-6455c72cc65b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:53.754571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:53.756287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:53.756738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:53.757016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] PATH_INFO: `/v3/users/dcbfe7d69cdb4d27a63b347a3385bc48` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:53.758223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbfe7d69cdb4d27a63b347a3385bc48)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:53.760497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:53.840794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:53.989592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbfe7d69cdb4d27a63b347a3385bc48'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:53.990264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbfe7d69cdb4d27a63b347a3385bc48'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:53.999363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbfe7d69cdb4d27a63b347a3385bc48'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:54.091032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbfe7d69cdb4d27a63b347a3385bc48'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:54.106446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbfe7d69cdb4d27a63b347a3385bc48'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:54.113258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1095/2190] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:53 2022] DELETE /identity/v3/users/dcbfe7d69cdb4d27a63b347a3385bc48 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:54.118784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0980b6-1418-4ebf-9732-74b784934bd9 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:54.120581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0980b6-1418-4ebf-9732-74b784934bd9 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:54.120581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0980b6-1418-4ebf-9732-74b784934bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:54.138364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8f0980b6-1418-4ebf-9732-74b784934bd9 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:54.139634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8f0980b6-1418-4ebf-9732-74b784934bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:54.202726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1096/2191] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:54.212526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:54.213917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:54.278919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4977c6e-e6c9-43c7-a245-ca73d105a3b9 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:54.283833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe1b5-fa15-4665-b65d-8ae785b111e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:54.284581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe1b5-fa15-4665-b65d-8ae785b111e3 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:54.284987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe1b5-fa15-4665-b65d-8ae785b111e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:54.285424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fe1b5-fa15-4665-b65d-8ae785b111e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:54.297639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fe1b5-fa15-4665-b65d-8ae785b111e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:54.299202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fe1b5-fa15-4665-b65d-8ae785b111e3 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:54.310967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1096/2192] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:54.612179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:54.829858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0980b6-1418-4ebf-9732-74b784934bd9 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:54.832375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8f0980b6-1418-4ebf-9732-74b784934bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:54.856187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0980b6-1418-4ebf-9732-74b784934bd9 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:54.868021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:54.881612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:54.882131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:54.882620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] PATH_INFO: `/v3/projects/bcd44de0eb894dd29839da14252cd079` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:54.884716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd44de0eb894dd29839da14252cd079)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:54.888385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:55.008381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd44de0eb894dd29839da14252cd079', 'request_id': 'req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.015097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd44de0eb894dd29839da14252cd079', 'request_id': 'req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.094297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd44de0eb894dd29839da14252cd079', 'request_id': 'req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.106631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] The token cache is being invalidate because project bcd44de0eb894dd29839da14252cd079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:55.106927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.107613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.109109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1097/2193] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:54 2022] DELETE /identity/v3/projects/bcd44de0eb894dd29839da14252cd079 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:55.113695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe1b5-fa15-4665-b65d-8ae785b111e3 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:55.124736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fe1b5-fa15-4665-b65d-8ae785b111e3 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:55.186018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:55.186637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:55.186941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:55.187252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] PATH_INFO: `/v3/users/4c3387a72b6d4db8a39491a82be189b4` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:55.188387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3387a72b6d4db8a39491a82be189b4)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:55.190382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:55.274666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:55.379582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3387a72b6d4db8a39491a82be189b4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.380191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3387a72b6d4db8a39491a82be189b4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.387770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3387a72b6d4db8a39491a82be189b4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.502495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3387a72b6d4db8a39491a82be189b4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.516299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ce30e0b2-4443-453c-a5a1-74abb4a8451b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3387a72b6d4db8a39491a82be189b4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:55.523433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1097/2194] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:55 2022] DELETE /identity/v3/users/4c3387a72b6d4db8a39491a82be189b4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:00:55.760370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:55.958353 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:55.962325 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:55.992737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e430c9-ad18-4828-a607-a5a9f3d34dfc admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:56.088648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:56.089391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:56.089674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:56.090163 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] PATH_INFO: `/v3/projects/7458d8b67500497fb1d484cd959974e4` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:56.091423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7458d8b67500497fb1d484cd959974e4)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:56.093698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:56.211204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7458d8b67500497fb1d484cd959974e4', 'request_id': 'req-103ef155-2263-480c-94bc-cf849d93cb4c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:56.217911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:56.219007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7458d8b67500497fb1d484cd959974e4', 'request_id': 'req-103ef155-2263-480c-94bc-cf849d93cb4c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:56.222549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:56.320669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7458d8b67500497fb1d484cd959974e4', 'request_id': 'req-103ef155-2263-480c-94bc-cf849d93cb4c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:56.332572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] The token cache is being invalidate because project 7458d8b67500497fb1d484cd959974e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:56.332882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:56.334357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-103ef155-2263-480c-94bc-cf849d93cb4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:56.335959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1098/2195] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:55 2022] DELETE /identity/v3/projects/7458d8b67500497fb1d484cd959974e4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:56.341365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4211a-d120-4d47-8fca-019fff42852e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:56.341652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4211a-d120-4d47-8fca-019fff42852e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:56.341929 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4211a-d120-4d47-8fca-019fff42852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:56.362409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-10a4211a-d120-4d47-8fca-019fff42852e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:56.363663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-10a4211a-d120-4d47-8fca-019fff42852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:56.432566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1098/2196] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:56.440578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfaf98-db3c-43cb-ac58-b968254712af None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:56.442595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfaf98-db3c-43cb-ac58-b968254712af None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:56.442595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfaf98-db3c-43cb-ac58-b968254712af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:56.465057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-2adfaf98-db3c-43cb-ac58-b968254712af None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:56.466326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2adfaf98-db3c-43cb-ac58-b968254712af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:56.484406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4211a-d120-4d47-8fca-019fff42852e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:56.485192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1099/2197] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:56.495328 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4211a-d120-4d47-8fca-019fff42852e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:56.501357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c158d80-3d02-4e50-b688-776ff971ca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:56.502116 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c158d80-3d02-4e50-b688-776ff971ca34 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:56.506415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c158d80-3d02-4e50-b688-776ff971ca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:56.506415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c158d80-3d02-4e50-b688-776ff971ca34 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:56.506415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c158d80-3d02-4e50-b688-776ff971ca34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:56.506415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c158d80-3d02-4e50-b688-776ff971ca34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:56.518899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c158d80-3d02-4e50-b688-776ff971ca34 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:56.557130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1099/2198] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:56.558599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfaf98-db3c-43cb-ac58-b968254712af None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:56.568964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfaf98-db3c-43cb-ac58-b968254712af None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:56.574380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a154e3-1073-4c57-b266-fd529f87934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:56.575122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a154e3-1073-4c57-b266-fd529f87934e admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:56.575498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a154e3-1073-4c57-b266-fd529f87934e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:56.575864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a154e3-1073-4c57-b266-fd529f87934e admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:56.576576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a154e3-1073-4c57-b266-fd529f87934e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:56.578508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a154e3-1073-4c57-b266-fd529f87934e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:56.702057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1100/2199] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:56 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:00:56.703189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c158d80-3d02-4e50-b688-776ff971ca34 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:56.717131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c158d80-3d02-4e50-b688-776ff971ca34 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:56.784425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59971719-61a0-4e15-a615-e0c02eeac3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:56.785050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59971719-61a0-4e15-a615-e0c02eeac3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:56.785331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59971719-61a0-4e15-a615-e0c02eeac3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:56.785608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59971719-61a0-4e15-a615-e0c02eeac3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:56.786261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59971719-61a0-4e15-a615-e0c02eeac3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:56.790009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59971719-61a0-4e15-a615-e0c02eeac3e3 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:56.805189 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:56.898984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1100/2200] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:56 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:56.902835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a154e3-1073-4c57-b266-fd529f87934e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:56.915857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a154e3-1073-4c57-b266-fd529f87934e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:56.922173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3039c1-dac5-44f4-a90b-b1cfe7f63138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:56.923548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3039c1-dac5-44f4-a90b-b1cfe7f63138 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:56.923548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3039c1-dac5-44f4-a90b-b1cfe7f63138 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:56.923792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3039c1-dac5-44f4-a90b-b1cfe7f63138 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:56.924583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3039c1-dac5-44f4-a90b-b1cfe7f63138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:56.926486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3039c1-dac5-44f4-a90b-b1cfe7f63138 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:56.947429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1101/2201] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:56.951847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59971719-61a0-4e15-a615-e0c02eeac3e3 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:56.982928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59971719-61a0-4e15-a615-e0c02eeac3e3 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:56.998259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae3c9d-9b95-4859-b73c-42daa62983bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:56.999104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae3c9d-9b95-4859-b73c-42daa62983bc admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:56.999569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae3c9d-9b95-4859-b73c-42daa62983bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:57.000067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae3c9d-9b95-4859-b73c-42daa62983bc admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:57.003318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae3c9d-9b95-4859-b73c-42daa62983bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:57.007260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae3c9d-9b95-4859-b73c-42daa62983bc admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:57.028201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1101/2202] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:57.029409 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3039c1-dac5-44f4-a90b-b1cfe7f63138 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:57.048816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3039c1-dac5-44f4-a90b-b1cfe7f63138 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:57.065872 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a15a6-b202-44aa-99d4-44e110c00703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:57.066562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a15a6-b202-44aa-99d4-44e110c00703 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:57.066841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a15a6-b202-44aa-99d4-44e110c00703 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:57.067118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a15a6-b202-44aa-99d4-44e110c00703 admin admin] PATH_INFO: `/v3/projects/e56533e8643c46d48cb7284b9aaa5cd7/users/84db90e642aa4bc199988fdcb499bac7/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:57.092211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a15a6-b202-44aa-99d4-44e110c00703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56533e8643c46d48cb7284b9aaa5cd7, user_id=84db90e642aa4bc199988fdcb499bac7, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:57.095264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a15a6-b202-44aa-99d4-44e110c00703 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:57.201471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1102/2203] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:57 2022] PUT /identity/v3/projects/e56533e8643c46d48cb7284b9aaa5cd7/users/84db90e642aa4bc199988fdcb499bac7/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:57.214291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414700-ae6d-4413-b0de-d4e641215d41 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:57.214706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414700-ae6d-4413-b0de-d4e641215d41 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:57.214986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414700-ae6d-4413-b0de-d4e641215d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:57.255018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-5e414700-ae6d-4413-b0de-d4e641215d41 None None] MFA Rules not processed for user `84db90e642aa4bc199988fdcb499bac7`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:57.257605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5e414700-ae6d-4413-b0de-d4e641215d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:57.356321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1102/2204] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:57.369663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a15a6-b202-44aa-99d4-44e110c00703 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:57.371859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-eb0a15a6-b202-44aa-99d4-44e110c00703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:57.464571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a15a6-b202-44aa-99d4-44e110c00703 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:57.468865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197b64e-f005-4c19-94dc-8dcfb9861ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:57.469835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197b64e-f005-4c19-94dc-8dcfb9861ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:57.470045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197b64e-f005-4c19-94dc-8dcfb9861ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:57.470377 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197b64e-f005-4c19-94dc-8dcfb9861ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:57.481486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197b64e-f005-4c19-94dc-8dcfb9861ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:57.485175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197b64e-f005-4c19-94dc-8dcfb9861ff0 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:57.497816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1103/2205] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:57.523833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e414700-ae6d-4413-b0de-d4e641215d41 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:57.632306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e414700-ae6d-4413-b0de-d4e641215d41 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:57.637384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:57.638023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:57.638297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:57.638568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] PATH_INFO: `/v3/users/84db90e642aa4bc199988fdcb499bac7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:57.639765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84db90e642aa4bc199988fdcb499bac7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:57.641816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:57.852409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:57.869025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84db90e642aa4bc199988fdcb499bac7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:57.869703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84db90e642aa4bc199988fdcb499bac7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:57.887879 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84db90e642aa4bc199988fdcb499bac7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:57.954182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84db90e642aa4bc199988fdcb499bac7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:57.971097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84db90e642aa4bc199988fdcb499bac7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:57.979106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1103/2206] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:00:57 2022] DELETE /identity/v3/users/84db90e642aa4bc199988fdcb499bac7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:57.984422 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a6fb-9f2d-476d-bd42-01254d8d8f91 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:57.985021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a6fb-9f2d-476d-bd42-01254d8d8f91 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:57.985300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a6fb-9f2d-476d-bd42-01254d8d8f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:58.010937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-2205a6fb-9f2d-476d-bd42-01254d8d8f91 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:58.012113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2205a6fb-9f2d-476d-bd42-01254d8d8f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:58.087265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1104/2207] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:00:58.109907 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:58.111822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:58.190210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3b663-421e-464d-90dc-6ee9bca2b431 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:58.195162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687eadeb-91fd-481e-a11c-ac9e0408ad96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:58.195908 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687eadeb-91fd-481e-a11c-ac9e0408ad96 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:58.197239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687eadeb-91fd-481e-a11c-ac9e0408ad96 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:58.197239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687eadeb-91fd-481e-a11c-ac9e0408ad96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:58.212225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687eadeb-91fd-481e-a11c-ac9e0408ad96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:58.213716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687eadeb-91fd-481e-a11c-ac9e0408ad96 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:58.225763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1104/2208] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:00:58.779148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205a6fb-9f2d-476d-bd42-01254d8d8f91 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:58.780705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2205a6fb-9f2d-476d-bd42-01254d8d8f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:58.796461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205a6fb-9f2d-476d-bd42-01254d8d8f91 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:58.802310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:58.803360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:58.803664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:58.803909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] PATH_INFO: `/v3/projects/e56533e8643c46d48cb7284b9aaa5cd7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:58.805301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56533e8643c46d48cb7284b9aaa5cd7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:58.807512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:58.832855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:58.969448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56533e8643c46d48cb7284b9aaa5cd7', 'request_id': 'req-c54d02b5-1639-43e6-89d4-fe2afae496d7'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:58.976485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56533e8643c46d48cb7284b9aaa5cd7', 'request_id': 'req-c54d02b5-1639-43e6-89d4-fe2afae496d7'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:59.045756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56533e8643c46d48cb7284b9aaa5cd7', 'request_id': 'req-c54d02b5-1639-43e6-89d4-fe2afae496d7'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:59.060156 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] The token cache is being invalidate because project e56533e8643c46d48cb7284b9aaa5cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:00:59.060710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:59.061421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c54d02b5-1639-43e6-89d4-fe2afae496d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:00:59.063082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1105/2209] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:00:58 2022] DELETE /identity/v3/projects/e56533e8643c46d48cb7284b9aaa5cd7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:59.072375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3437a6-7cc5-4b76-94fd-16260ed919f6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:59.072853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3437a6-7cc5-4b76-94fd-16260ed919f6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:59.073091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3437a6-7cc5-4b76-94fd-16260ed919f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:59.101850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7a3437a6-7cc5-4b76-94fd-16260ed919f6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:59.103182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7a3437a6-7cc5-4b76-94fd-16260ed919f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:59.169311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1105/2210] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:59.177183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1770d69-da6f-4bc0-8825-610ad4bee690 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:59.177183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1770d69-da6f-4bc0-8825-610ad4bee690 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:59.178581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1770d69-da6f-4bc0-8825-610ad4bee690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:59.206534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d1770d69-da6f-4bc0-8825-610ad4bee690 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:59.207855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d1770d69-da6f-4bc0-8825-610ad4bee690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:00:59.217251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1106/2211] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:00:59.221666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3437a6-7cc5-4b76-94fd-16260ed919f6 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:59.234763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3437a6-7cc5-4b76-94fd-16260ed919f6 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:59.239481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd652a6-65b1-4844-868e-06af25978eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:59.240192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd652a6-65b1-4844-868e-06af25978eea admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:59.240408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd652a6-65b1-4844-868e-06af25978eea admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:59.240675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd652a6-65b1-4844-868e-06af25978eea admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:59.241321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd652a6-65b1-4844-868e-06af25978eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:00:59.241620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd652a6-65b1-4844-868e-06af25978eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:59.243239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd652a6-65b1-4844-868e-06af25978eea admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:59.255004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1106/2212] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:00:59.260132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1770d69-da6f-4bc0-8825-610ad4bee690 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:59.272084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1770d69-da6f-4bc0-8825-610ad4bee690 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:59.278146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4bccb-090f-436d-8d65-16777b4cfb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:59.278848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4bccb-090f-436d-8d65-16777b4cfb33 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:59.279122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4bccb-090f-436d-8d65-16777b4cfb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:59.279498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4bccb-090f-436d-8d65-16777b4cfb33 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:59.280191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4bccb-090f-436d-8d65-16777b4cfb33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:59.284421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4bccb-090f-436d-8d65-16777b4cfb33 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:59.392746 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1107/2213] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:00:59 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:59.397034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd652a6-65b1-4844-868e-06af25978eea admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:59.417899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd652a6-65b1-4844-868e-06af25978eea admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:59.490422 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:00:59.514565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb94e3-9b4b-4d7f-85b7-d4f96a25ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:59.515320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb94e3-9b4b-4d7f-85b7-d4f96a25ecec admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:59.515677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb94e3-9b4b-4d7f-85b7-d4f96a25ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:59.516014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb94e3-9b4b-4d7f-85b7-d4f96a25ecec admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:59.516714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb94e3-9b4b-4d7f-85b7-d4f96a25ecec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:59.518770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb94e3-9b4b-4d7f-85b7-d4f96a25ecec admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:59.657626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1107/2214] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:00:59 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:00:59.661939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4bccb-090f-436d-8d65-16777b4cfb33 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:59.674071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4bccb-090f-436d-8d65-16777b4cfb33 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:59.680596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9553-7759-4754-91a5-25e74f0481b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:59.681472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9553-7759-4754-91a5-25e74f0481b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:59.681800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9553-7759-4754-91a5-25e74f0481b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:59.682226 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9553-7759-4754-91a5-25e74f0481b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:59.683036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d9553-7759-4754-91a5-25e74f0481b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:59.685168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d9553-7759-4754-91a5-25e74f0481b6 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:59.703406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1108/2215] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:59.718390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb94e3-9b4b-4d7f-85b7-d4f96a25ecec admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:59.730804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb94e3-9b4b-4d7f-85b7-d4f96a25ecec admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:59.735909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4403c1e-1d26-4871-a19f-1d4605d66e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:59.736546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4403c1e-1d26-4871-a19f-1d4605d66e3c admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:59.736853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4403c1e-1d26-4871-a19f-1d4605d66e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:59.737151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4403c1e-1d26-4871-a19f-1d4605d66e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:59.738437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4403c1e-1d26-4871-a19f-1d4605d66e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:59.740636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4403c1e-1d26-4871-a19f-1d4605d66e3c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:59.752209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1108/2216] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:00:59.757210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9553-7759-4754-91a5-25e74f0481b6 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:00:59.768144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9553-7759-4754-91a5-25e74f0481b6 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:00:59.773578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def835cc-2bf3-450b-b8e6-981efeb035fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:00:59.774249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def835cc-2bf3-450b-b8e6-981efeb035fd admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:59.774529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def835cc-2bf3-450b-b8e6-981efeb035fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:59.774798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def835cc-2bf3-450b-b8e6-981efeb035fd admin admin] PATH_INFO: `/v3/projects/dad78d364d3f4204b98d0da6562d6f5d/users/29d6ae428529445187f07ed57d34e88f/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:59.792994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def835cc-2bf3-450b-b8e6-981efeb035fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad78d364d3f4204b98d0da6562d6f5d, user_id=29d6ae428529445187f07ed57d34e88f, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:00:59.795755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def835cc-2bf3-450b-b8e6-981efeb035fd admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:00:59.900498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1109/2217] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:00:59 2022] PUT /identity/v3/projects/dad78d364d3f4204b98d0da6562d6f5d/users/29d6ae428529445187f07ed57d34e88f/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:00:59.911403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c848ca-1401-40db-b162-719d36524316 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:00:59.911622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c848ca-1401-40db-b162-719d36524316 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:00:59.911926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c848ca-1401-40db-b162-719d36524316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:00:59.946219 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-79c848ca-1401-40db-b162-719d36524316 None None] MFA Rules not processed for user `29d6ae428529445187f07ed57d34e88f`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:00:59.947504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-79c848ca-1401-40db-b162-719d36524316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:00.022462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1109/2218] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:00:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:00.027369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def835cc-2bf3-450b-b8e6-981efeb035fd admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:00.096904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def835cc-2bf3-450b-b8e6-981efeb035fd admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:00.102070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d837-40ec-4a2d-9076-451a2c2b777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:00.102818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d837-40ec-4a2d-9076-451a2c2b777a admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:00.103456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d837-40ec-4a2d-9076-451a2c2b777a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:00.103456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67d837-40ec-4a2d-9076-451a2c2b777a admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:00.104056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67d837-40ec-4a2d-9076-451a2c2b777a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:00.106100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67d837-40ec-4a2d-9076-451a2c2b777a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:00.218255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1110/2219] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:01:00 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:00.219481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c848ca-1401-40db-b162-719d36524316 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:00.234299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c848ca-1401-40db-b162-719d36524316 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:00.328873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed48a9b-a494-411f-88c6-5b3ffbfb0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:00.330214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed48a9b-a494-411f-88c6-5b3ffbfb0e89 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:00.330501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed48a9b-a494-411f-88c6-5b3ffbfb0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:00.330777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed48a9b-a494-411f-88c6-5b3ffbfb0e89 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:00.331472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed48a9b-a494-411f-88c6-5b3ffbfb0e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:00.333497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed48a9b-a494-411f-88c6-5b3ffbfb0e89 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:00.435623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1110/2220] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:01:00 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:01:00.441616 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d837-40ec-4a2d-9076-451a2c2b777a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:00.453056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67d837-40ec-4a2d-9076-451a2c2b777a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:00.457798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e81cad-930a-4cbe-b795-df4cfe86a89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:00.458400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e81cad-930a-4cbe-b795-df4cfe86a89f admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:00.458697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e81cad-930a-4cbe-b795-df4cfe86a89f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:00.458968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e81cad-930a-4cbe-b795-df4cfe86a89f admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:00.461938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e81cad-930a-4cbe-b795-df4cfe86a89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:00.461938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e81cad-930a-4cbe-b795-df4cfe86a89f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:00.475478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1111/2221] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:00.480627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed48a9b-a494-411f-88c6-5b3ffbfb0e89 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:00.492881 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed48a9b-a494-411f-88c6-5b3ffbfb0e89 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:00.497524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b950fa3-595e-4499-959f-e59e2856a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:00.498221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b950fa3-595e-4499-959f-e59e2856a277 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:00.498604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b950fa3-595e-4499-959f-e59e2856a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:00.498963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b950fa3-595e-4499-959f-e59e2856a277 admin admin] PATH_INFO: `/v3/projects/88b967abaf2a480386de91e400fe161a/users/9b67eaeec7ae4bcdb5123085d9cb0542/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:00.516513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b950fa3-595e-4499-959f-e59e2856a277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b967abaf2a480386de91e400fe161a, user_id=9b67eaeec7ae4bcdb5123085d9cb0542, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:00.519199 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b950fa3-595e-4499-959f-e59e2856a277 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:00.604504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1111/2222] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:01:00 2022] PUT /identity/v3/projects/88b967abaf2a480386de91e400fe161a/users/9b67eaeec7ae4bcdb5123085d9cb0542/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:01:00.608478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e81cad-930a-4cbe-b795-df4cfe86a89f admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:00.621063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e81cad-930a-4cbe-b795-df4cfe86a89f admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:00.644464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:00.700368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a89fe-1fe8-40b2-8026-8cafda2234b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:00.701248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a89fe-1fe8-40b2-8026-8cafda2234b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:00.701529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a89fe-1fe8-40b2-8026-8cafda2234b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:00.701802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a89fe-1fe8-40b2-8026-8cafda2234b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:00.702452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a89fe-1fe8-40b2-8026-8cafda2234b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:00.704363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a89fe-1fe8-40b2-8026-8cafda2234b7 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:00.717393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1112/2223] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:00.721373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b950fa3-595e-4499-959f-e59e2856a277 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:00.735321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b950fa3-595e-4499-959f-e59e2856a277 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:00.740406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c350d72-9fd3-4026-90fe-11fae2633643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:00.741577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c350d72-9fd3-4026-90fe-11fae2633643 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:00.741851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c350d72-9fd3-4026-90fe-11fae2633643 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:00.742126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c350d72-9fd3-4026-90fe-11fae2633643 admin admin] PATH_INFO: `/v3/projects/88b967abaf2a480386de91e400fe161a/users/9b67eaeec7ae4bcdb5123085d9cb0542/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:00.744931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c350d72-9fd3-4026-90fe-11fae2633643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b967abaf2a480386de91e400fe161a, user_id=9b67eaeec7ae4bcdb5123085d9cb0542, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:00.747691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c350d72-9fd3-4026-90fe-11fae2633643 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:00.759720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1112/2224] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:01:00 2022] PUT /identity/v3/projects/88b967abaf2a480386de91e400fe161a/users/9b67eaeec7ae4bcdb5123085d9cb0542/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:01:00.771602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1daf2f-e469-458a-be58-eee14af4a24b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:00.771911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1daf2f-e469-458a-be58-eee14af4a24b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:00.772178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1daf2f-e469-458a-be58-eee14af4a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:00.808930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0d1daf2f-e469-458a-be58-eee14af4a24b None None] MFA Rules not processed for user `9b67eaeec7ae4bcdb5123085d9cb0542`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:00.810272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0d1daf2f-e469-458a-be58-eee14af4a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:00.890063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1113/2225] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:01:00.902267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c350d72-9fd3-4026-90fe-11fae2633643 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:00.904032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8c350d72-9fd3-4026-90fe-11fae2633643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:00.910482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:00.973603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c350d72-9fd3-4026-90fe-11fae2633643 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:00.978460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897a8e7-ee03-4750-a595-2e7454cf0e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:00.979070 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897a8e7-ee03-4750-a595-2e7454cf0e18 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:00.979375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897a8e7-ee03-4750-a595-2e7454cf0e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:00.979650 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897a8e7-ee03-4750-a595-2e7454cf0e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:01.048466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897a8e7-ee03-4750-a595-2e7454cf0e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:01.049930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897a8e7-ee03-4750-a595-2e7454cf0e18 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:01.060132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1113/2226] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:04.541574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1daf2f-e469-458a-be58-eee14af4a24b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:04.629628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1daf2f-e469-458a-be58-eee14af4a24b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:04.634673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:04.635358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:04.635638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:04.635910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] PATH_INFO: `/v3/users/29d6ae428529445187f07ed57d34e88f` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:04.637552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d6ae428529445187f07ed57d34e88f)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:04.639548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:04.893788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:04.896942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d6ae428529445187f07ed57d34e88f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:04.897841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d6ae428529445187f07ed57d34e88f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:04.962271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d6ae428529445187f07ed57d34e88f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:04.972376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d6ae428529445187f07ed57d34e88f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:04.985887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d6ae428529445187f07ed57d34e88f'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:04.996936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1114/2227] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:04 2022] DELETE /identity/v3/users/29d6ae428529445187f07ed57d34e88f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:05.001533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f3aad-4a66-4683-92b9-bd233c910cc8 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:05.001988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f3aad-4a66-4683-92b9-bd233c910cc8 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:05.002095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f3aad-4a66-4683-92b9-bd233c910cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:05.022273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0c7f3aad-4a66-4683-92b9-bd233c910cc8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:05.023720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0c7f3aad-4a66-4683-92b9-bd233c910cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:05.093059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1114/2228] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:05.103824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:05.105313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:05.176220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cd150-fa72-4f28-b231-0c07ec6985bc admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:05.180445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c5d1-6cea-40a0-8085-3cd5e3c0b579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:05.181162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c5d1-6cea-40a0-8085-3cd5e3c0b579 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:05.181442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c5d1-6cea-40a0-8085-3cd5e3c0b579 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:05.181720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c5d1-6cea-40a0-8085-3cd5e3c0b579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:05.192136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079c5d1-6cea-40a0-8085-3cd5e3c0b579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:05.193651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079c5d1-6cea-40a0-8085-3cd5e3c0b579 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:05.203836 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1115/2229] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:05.815522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f3aad-4a66-4683-92b9-bd233c910cc8 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:05.817692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0c7f3aad-4a66-4683-92b9-bd233c910cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:05.830687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f3aad-4a66-4683-92b9-bd233c910cc8 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:05.844572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:05.845321 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:05.845664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:05.845924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] PATH_INFO: `/v3/projects/dad78d364d3f4204b98d0da6562d6f5d` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:05.847699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad78d364d3f4204b98d0da6562d6f5d)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:05.850487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:05.991315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad78d364d3f4204b98d0da6562d6f5d', 'request_id': 'req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:05.993849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:05.997849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad78d364d3f4204b98d0da6562d6f5d', 'request_id': 'req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:06.004023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad78d364d3f4204b98d0da6562d6f5d', 'request_id': 'req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:06.114250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] The token cache is being invalidate because project dad78d364d3f4204b98d0da6562d6f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:06.114486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:06.115928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:06.117443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1115/2230] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:05 2022] DELETE /identity/v3/projects/dad78d364d3f4204b98d0da6562d6f5d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:06.121527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c5d1-6cea-40a0-8085-3cd5e3c0b579 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:06.133128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c5d1-6cea-40a0-8085-3cd5e3c0b579 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:06.191515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:06.192049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:06.192328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:06.192602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] PATH_INFO: `/v3/users/9b67eaeec7ae4bcdb5123085d9cb0542` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:06.193744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b67eaeec7ae4bcdb5123085d9cb0542)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:06.195754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:06.413484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b67eaeec7ae4bcdb5123085d9cb0542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:06.414275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b67eaeec7ae4bcdb5123085d9cb0542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:06.482352 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b67eaeec7ae4bcdb5123085d9cb0542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:06.491134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b67eaeec7ae4bcdb5123085d9cb0542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:06.493737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:06.504232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9dbc2e11-6dc5-4016-aca2-623d92a5f466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b67eaeec7ae4bcdb5123085d9cb0542'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:06.510654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1116/2231] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:06 2022] DELETE /identity/v3/users/9b67eaeec7ae4bcdb5123085d9cb0542 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:07.063332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:07.064875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:07.091538 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352defcc-406d-4f2a-8b3c-3fe6bb46c8c7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:07.171715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:07.172369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:07.172681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:07.172955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] PATH_INFO: `/v3/projects/88b967abaf2a480386de91e400fe161a` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:07.174679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b967abaf2a480386de91e400fe161a)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:07.177129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:07.313072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b967abaf2a480386de91e400fe161a', 'request_id': 'req-917f1aff-7ae1-4eac-8917-5d0919812c9a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:07.319800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b967abaf2a480386de91e400fe161a', 'request_id': 'req-917f1aff-7ae1-4eac-8917-5d0919812c9a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:07.326280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b967abaf2a480386de91e400fe161a', 'request_id': 'req-917f1aff-7ae1-4eac-8917-5d0919812c9a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:07.421294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] The token cache is being invalidate because project 88b967abaf2a480386de91e400fe161a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:07.421648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:07.423296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-917f1aff-7ae1-4eac-8917-5d0919812c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:07.424805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1116/2232] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:07 2022] DELETE /identity/v3/projects/88b967abaf2a480386de91e400fe161a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:01:07.431755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053108d8-f4c1-407e-b0d7-f3bd7d53d883 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:07.432269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053108d8-f4c1-407e-b0d7-f3bd7d53d883 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:07.432363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053108d8-f4c1-407e-b0d7-f3bd7d53d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:07.454476 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-053108d8-f4c1-407e-b0d7-f3bd7d53d883 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:07.455800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-053108d8-f4c1-407e-b0d7-f3bd7d53d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:07.523432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1117/2233] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:07.531038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80678927-da5f-4a67-bcae-cc9ae398240a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:07.531356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80678927-da5f-4a67-bcae-cc9ae398240a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:07.531627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80678927-da5f-4a67-bcae-cc9ae398240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:07.552049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-80678927-da5f-4a67-bcae-cc9ae398240a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:07.553918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-80678927-da5f-4a67-bcae-cc9ae398240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:07.561749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1117/2234] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:07.566064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053108d8-f4c1-407e-b0d7-f3bd7d53d883 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:07.576742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053108d8-f4c1-407e-b0d7-f3bd7d53d883 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:07.581392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b664d-bc49-4353-92ab-c1da26afd3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:07.581988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b664d-bc49-4353-92ab-c1da26afd3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:07.582264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b664d-bc49-4353-92ab-c1da26afd3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:07.582532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b664d-bc49-4353-92ab-c1da26afd3f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:07.583193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b664d-bc49-4353-92ab-c1da26afd3f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:01:07.583535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b664d-bc49-4353-92ab-c1da26afd3f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:07.585253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b664d-bc49-4353-92ab-c1da26afd3f6 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:07.597988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1118/2235] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:01:07.605505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80678927-da5f-4a67-bcae-cc9ae398240a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:07.615719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80678927-da5f-4a67-bcae-cc9ae398240a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:07.620712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d19e-229f-446d-bf0c-171b57190798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:07.621446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d19e-229f-446d-bf0c-171b57190798 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:07.621615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d19e-229f-446d-bf0c-171b57190798 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:07.621892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d19e-229f-446d-bf0c-171b57190798 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:07.623638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3d19e-229f-446d-bf0c-171b57190798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:07.626257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3d19e-229f-446d-bf0c-171b57190798 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:07.780260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1118/2236] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:01:07 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:07.781992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b664d-bc49-4353-92ab-c1da26afd3f6 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:07.792844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b664d-bc49-4353-92ab-c1da26afd3f6 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:07.856570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae779956-19cd-4016-afb1-63d1d7c2730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:07.857186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae779956-19cd-4016-afb1-63d1d7c2730e admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:07.857465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae779956-19cd-4016-afb1-63d1d7c2730e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:07.857734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae779956-19cd-4016-afb1-63d1d7c2730e admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:07.858364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae779956-19cd-4016-afb1-63d1d7c2730e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:07.860609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae779956-19cd-4016-afb1-63d1d7c2730e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:07.998159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1119/2237] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:01:07 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:08.002428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d19e-229f-446d-bf0c-171b57190798 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:08.014379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d19e-229f-446d-bf0c-171b57190798 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:08.020020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a590bd-7bb7-4f62-b622-1fda45855d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:08.023598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a590bd-7bb7-4f62-b622-1fda45855d4b admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:08.023598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a590bd-7bb7-4f62-b622-1fda45855d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:08.023598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a590bd-7bb7-4f62-b622-1fda45855d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:08.023598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a590bd-7bb7-4f62-b622-1fda45855d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:08.023921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a590bd-7bb7-4f62-b622-1fda45855d4b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:08.034496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1119/2238] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:08.038841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae779956-19cd-4016-afb1-63d1d7c2730e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:08.049077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae779956-19cd-4016-afb1-63d1d7c2730e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:08.055171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d084cef-d2e3-4c6e-85c3-bb426da5da1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:08.055938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d084cef-d2e3-4c6e-85c3-bb426da5da1d admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:08.056217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d084cef-d2e3-4c6e-85c3-bb426da5da1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:08.056585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d084cef-d2e3-4c6e-85c3-bb426da5da1d admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:08.057384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d084cef-d2e3-4c6e-85c3-bb426da5da1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:08.059039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d084cef-d2e3-4c6e-85c3-bb426da5da1d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:08.071659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1120/2239] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:08.076216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a590bd-7bb7-4f62-b622-1fda45855d4b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:08.086756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a590bd-7bb7-4f62-b622-1fda45855d4b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:08.091469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53328d-5636-4619-a36c-51ab4deb574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:08.092181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53328d-5636-4619-a36c-51ab4deb574e admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:08.092428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53328d-5636-4619-a36c-51ab4deb574e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:08.092698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53328d-5636-4619-a36c-51ab4deb574e admin admin] PATH_INFO: `/v3/projects/460fe89606fd484791e3e683aa6c9068/users/37b45e6d825947ce87d70277522964a2/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:08.112028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53328d-5636-4619-a36c-51ab4deb574e admin admin] RBAC: Authorizing `identity:create_grant(project_id=460fe89606fd484791e3e683aa6c9068, user_id=37b45e6d825947ce87d70277522964a2, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:08.115318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53328d-5636-4619-a36c-51ab4deb574e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:08.221113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1120/2240] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:01:08 2022] PUT /identity/v3/projects/460fe89606fd484791e3e683aa6c9068/users/37b45e6d825947ce87d70277522964a2/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:08.227328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74517f-3b8b-44da-912e-e4189ac19c18 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:08.227698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74517f-3b8b-44da-912e-e4189ac19c18 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:08.228038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74517f-3b8b-44da-912e-e4189ac19c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:08.252712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-2f74517f-3b8b-44da-912e-e4189ac19c18 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:08.254050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2f74517f-3b8b-44da-912e-e4189ac19c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:08.307795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:08.325955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1121/2241] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:01:08.340056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53328d-5636-4619-a36c-51ab4deb574e admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:08.341857 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ad53328d-5636-4619-a36c-51ab4deb574e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:08.357525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:08.438654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53328d-5636-4619-a36c-51ab4deb574e admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:08.442378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeadc92-9098-468d-adf1-abcc1aaefcbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:08.443552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeadc92-9098-468d-adf1-abcc1aaefcbb service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:08.443832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeadc92-9098-468d-adf1-abcc1aaefcbb service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:08.444203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeadc92-9098-468d-adf1-abcc1aaefcbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:08.455956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeadc92-9098-468d-adf1-abcc1aaefcbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:08.457564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeadc92-9098-468d-adf1-abcc1aaefcbb service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:08.478407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1121/2242] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:09.784729 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce04878-b49a-419a-8b5d-abce2db401dc None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:09.785258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce04878-b49a-419a-8b5d-abce2db401dc None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:09.785407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce04878-b49a-419a-8b5d-abce2db401dc None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:09.787002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1122/2243] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 20:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:01:09.799339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaf197-6a18-4b60-9458-18520dc862f6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:09.802895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaf197-6a18-4b60-9458-18520dc862f6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:09.802895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aaf197-6a18-4b60-9458-18520dc862f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:09.835600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b4aaf197-6a18-4b60-9458-18520dc862f6 None None] MFA Rules not processed for user `1ef51739456e4beb9ae0f107b13d55f5`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:09.842684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b4aaf197-6a18-4b60-9458-18520dc862f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:09.918813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1122/2244] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 20:01:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:09.932535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce04878-b49a-419a-8b5d-abce2db401dc None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:09.934588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5ce04878-b49a-419a-8b5d-abce2db401dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:09.956374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce04878-b49a-419a-8b5d-abce2db401dc None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:09.964314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e14aeb-ad4a-4739-b558-364b09da18c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:09.965030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e14aeb-ad4a-4739-b558-364b09da18c1 service placement] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:09.965628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e14aeb-ad4a-4739-b558-364b09da18c1 service placement] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:09.965996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e14aeb-ad4a-4739-b558-364b09da18c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:09.983947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e14aeb-ad4a-4739-b558-364b09da18c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:09.987327 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e14aeb-ad4a-4739-b558-364b09da18c1 service placement] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:10.007802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1123/2245] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:10.028382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f894cc6-83d4-4daa-b2ca-14565d229d93 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:10.028665 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f894cc6-83d4-4daa-b2ca-14565d229d93 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:10.028949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f894cc6-83d4-4daa-b2ca-14565d229d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:10.073055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0f894cc6-83d4-4daa-b2ca-14565d229d93 None None] MFA Rules not processed for user `37b45e6d825947ce87d70277522964a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:10.074276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0f894cc6-83d4-4daa-b2ca-14565d229d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:10.182024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1123/2246] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:10.196229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e14aeb-ad4a-4739-b558-364b09da18c1 service placement] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:10.198229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-42e14aeb-ad4a-4739-b558-364b09da18c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:10.274623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e14aeb-ad4a-4739-b558-364b09da18c1 service placement] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:10.279849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb953fa-9074-4427-830d-f4093ac4520f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:10.301536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb953fa-9074-4427-830d-f4093ac4520f service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:10.301536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb953fa-9074-4427-830d-f4093ac4520f service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:10.301536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb953fa-9074-4427-830d-f4093ac4520f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:10.301536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb953fa-9074-4427-830d-f4093ac4520f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:10.301536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb953fa-9074-4427-830d-f4093ac4520f service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:10.307067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1124/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:10.910366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f894cc6-83d4-4daa-b2ca-14565d229d93 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:10.912621 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0f894cc6-83d4-4daa-b2ca-14565d229d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:10.933718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f894cc6-83d4-4daa-b2ca-14565d229d93 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:10.939317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:10.940044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:10.940385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:10.940890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] PATH_INFO: `/v3/users/7244451548bb4058bf9927a16b3af61b` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:10.942149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7244451548bb4058bf9927a16b3af61b)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:10.944442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:11.158093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:11.173519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7244451548bb4058bf9927a16b3af61b'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.174176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7244451548bb4058bf9927a16b3af61b'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.181720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7244451548bb4058bf9927a16b3af61b'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.277598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7244451548bb4058bf9927a16b3af61b'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.292022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7244451548bb4058bf9927a16b3af61b'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.298029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1124/2248] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:10 2022] DELETE /identity/v3/users/7244451548bb4058bf9927a16b3af61b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:11.661790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb953fa-9074-4427-830d-f4093ac4520f service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:11.680524 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb953fa-9074-4427-830d-f4093ac4520f service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:11.754603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:11.755060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:11.755447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:11.755718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] PATH_INFO: `/v3/projects/78f1eb2ddcf84a90917960c114a393c9` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:11.757112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f1eb2ddcf84a90917960c114a393c9)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:11.759058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:11.856401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f1eb2ddcf84a90917960c114a393c9', 'request_id': 'req-6859040f-5e44-40c1-abf0-9a71a3ac7409'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.863122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f1eb2ddcf84a90917960c114a393c9', 'request_id': 'req-6859040f-5e44-40c1-abf0-9a71a3ac7409'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.928762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f1eb2ddcf84a90917960c114a393c9', 'request_id': 'req-6859040f-5e44-40c1-abf0-9a71a3ac7409'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.942461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] The token cache is being invalidate because project 78f1eb2ddcf84a90917960c114a393c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:11.942737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.943545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:11.945101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1125/2249] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:11 2022] DELETE /identity/v3/projects/78f1eb2ddcf84a90917960c114a393c9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:11.949345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:11.951485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:11.967905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bf6b1-5ad2-4e29-a005-221665a6a007 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:12.051447 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:12.052182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:12.052995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:12.053272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] PATH_INFO: `/v3/users/ee03387c96a04d5cbc9ec33a8a3b27af` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:12.054488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee03387c96a04d5cbc9ec33a8a3b27af)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:12.056496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:12.310511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee03387c96a04d5cbc9ec33a8a3b27af'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:12.311177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee03387c96a04d5cbc9ec33a8a3b27af'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:12.319113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee03387c96a04d5cbc9ec33a8a3b27af'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:12.382304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee03387c96a04d5cbc9ec33a8a3b27af'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:12.395143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-b33aaa74-3b59-4744-a8c9-d22a0aba7641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee03387c96a04d5cbc9ec33a8a3b27af'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:12.404917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1125/2250] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:11 2022] DELETE /identity/v3/users/ee03387c96a04d5cbc9ec33a8a3b27af => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:12.707385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:12.709690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:12.732642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859040f-5e44-40c1-abf0-9a71a3ac7409 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:12.740881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:12.864741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:12.865559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:12.865858 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:12.866125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] PATH_INFO: `/v3/projects/de8fdd6b915c4d39931c8dec892370f9` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:12.867381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8fdd6b915c4d39931c8dec892370f9)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:12.869344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:12.975156 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8fdd6b915c4d39931c8dec892370f9', 'request_id': 'req-82b9737e-0515-4d07-b4bd-56edf840811e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:12.982657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8fdd6b915c4d39931c8dec892370f9', 'request_id': 'req-82b9737e-0515-4d07-b4bd-56edf840811e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:13.085903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8fdd6b915c4d39931c8dec892370f9', 'request_id': 'req-82b9737e-0515-4d07-b4bd-56edf840811e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:13.098172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] The token cache is being invalidate because project de8fdd6b915c4d39931c8dec892370f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:13.098483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:13.099154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-82b9737e-0515-4d07-b4bd-56edf840811e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:13.100855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1126/2251] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:12 2022] DELETE /identity/v3/projects/de8fdd6b915c4d39931c8dec892370f9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:13.105831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f9bc-ae3e-44e9-9e33-ce837861fe9f None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:13.106305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f9bc-ae3e-44e9-9e33-ce837861fe9f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:13.106444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f9bc-ae3e-44e9-9e33-ce837861fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:13.132341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6424f9bc-ae3e-44e9-9e33-ce837861fe9f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:13.133587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6424f9bc-ae3e-44e9-9e33-ce837861fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:13.157674 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:13.210298 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1126/2252] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:01:13.214462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845c7cb-647d-44b0-ab74-f5df6fc6a82a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:13.216320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845c7cb-647d-44b0-ab74-f5df6fc6a82a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:13.216320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845c7cb-647d-44b0-ab74-f5df6fc6a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:13.244090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6845c7cb-647d-44b0-ab74-f5df6fc6a82a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:13.245322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6845c7cb-647d-44b0-ab74-f5df6fc6a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:13.253461 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1127/2253] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:13.258589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424f9bc-ae3e-44e9-9e33-ce837861fe9f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:13.268781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424f9bc-ae3e-44e9-9e33-ce837861fe9f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:13.273639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8161b3-6e4a-457f-a18e-da14237faea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:13.274387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8161b3-6e4a-457f-a18e-da14237faea6 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:13.274687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8161b3-6e4a-457f-a18e-da14237faea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:13.274958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8161b3-6e4a-457f-a18e-da14237faea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:13.275640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8161b3-6e4a-457f-a18e-da14237faea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:01:13.275936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8161b3-6e4a-457f-a18e-da14237faea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:13.277703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8161b3-6e4a-457f-a18e-da14237faea6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:13.289779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1127/2254] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:01:13.294164 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845c7cb-647d-44b0-ab74-f5df6fc6a82a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:13.304959 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845c7cb-647d-44b0-ab74-f5df6fc6a82a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:13.311087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284b60-3bde-477e-a4cd-6bda65a3451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:13.311584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284b60-3bde-477e-a4cd-6bda65a3451d admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:13.311984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284b60-3bde-477e-a4cd-6bda65a3451d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:13.312146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d284b60-3bde-477e-a4cd-6bda65a3451d admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:13.312790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d284b60-3bde-477e-a4cd-6bda65a3451d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:13.314776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d284b60-3bde-477e-a4cd-6bda65a3451d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:13.413004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1128/2255] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:01:13 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:13.418633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8161b3-6e4a-457f-a18e-da14237faea6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:13.429739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8161b3-6e4a-457f-a18e-da14237faea6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:13.502461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0fac3-da49-4140-873a-095e3b3eeb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:13.503067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0fac3-da49-4140-873a-095e3b3eeb69 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:13.503389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0fac3-da49-4140-873a-095e3b3eeb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:13.503666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0fac3-da49-4140-873a-095e3b3eeb69 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:13.504290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0fac3-da49-4140-873a-095e3b3eeb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:13.506792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0fac3-da49-4140-873a-095e3b3eeb69 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:13.771953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1128/2256] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:01:13 2022] POST /identity/v3/users => generated 286 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:13.776236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284b60-3bde-477e-a4cd-6bda65a3451d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:13.787520 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d284b60-3bde-477e-a4cd-6bda65a3451d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:13.792158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb27d18-7e08-47a7-bd6a-47d42d276854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:13.792674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb27d18-7e08-47a7-bd6a-47d42d276854 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:13.792932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb27d18-7e08-47a7-bd6a-47d42d276854 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:13.793204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb27d18-7e08-47a7-bd6a-47d42d276854 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:13.793847 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb27d18-7e08-47a7-bd6a-47d42d276854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:13.795671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb27d18-7e08-47a7-bd6a-47d42d276854 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:13.807675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1129/2257] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:13.812159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0fac3-da49-4140-873a-095e3b3eeb69 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:13.822349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0fac3-da49-4140-873a-095e3b3eeb69 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:13.827613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88682945-fb7a-41b8-aa8a-0e79889fd3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:13.828221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682945-fb7a-41b8-aa8a-0e79889fd3df admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:13.828495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682945-fb7a-41b8-aa8a-0e79889fd3df admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:13.828763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88682945-fb7a-41b8-aa8a-0e79889fd3df admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:13.829409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88682945-fb7a-41b8-aa8a-0e79889fd3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:13.831010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88682945-fb7a-41b8-aa8a-0e79889fd3df admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:13.842499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1129/2258] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:13.847880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb27d18-7e08-47a7-bd6a-47d42d276854 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:13.860104 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb27d18-7e08-47a7-bd6a-47d42d276854 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:13.866077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820e865-b6d3-4c26-90d4-8f563f4f184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:13.866839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820e865-b6d3-4c26-90d4-8f563f4f184a admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:13.867182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820e865-b6d3-4c26-90d4-8f563f4f184a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:13.873012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820e865-b6d3-4c26-90d4-8f563f4f184a admin admin] PATH_INFO: `/v3/projects/93b58f88ef4f421bb772237bc50bd8d7/users/a12f7223d66b4e7597d017986b98db90/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:13.883724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820e865-b6d3-4c26-90d4-8f563f4f184a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b58f88ef4f421bb772237bc50bd8d7, user_id=a12f7223d66b4e7597d017986b98db90, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:13.886993 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820e865-b6d3-4c26-90d4-8f563f4f184a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:13.980932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1130/2259] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:01:13 2022] PUT /identity/v3/projects/93b58f88ef4f421bb772237bc50bd8d7/users/a12f7223d66b4e7597d017986b98db90/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:13.997445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f1d3-57e3-473f-946e-7b552c5d2f7b None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:13.997445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f1d3-57e3-473f-946e-7b552c5d2f7b None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:13.997445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f1d3-57e3-473f-946e-7b552c5d2f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:14.027504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-d012f1d3-57e3-473f-946e-7b552c5d2f7b None None] MFA Rules not processed for user `a12f7223d66b4e7597d017986b98db90`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:14.028771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d012f1d3-57e3-473f-946e-7b552c5d2f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:14.110215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1130/2260] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:01:14.121821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820e865-b6d3-4c26-90d4-8f563f4f184a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:14.123964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1820e865-b6d3-4c26-90d4-8f563f4f184a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:14.171214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:14.189719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820e865-b6d3-4c26-90d4-8f563f4f184a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:14.194720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4f3f3-a939-4d76-a56c-620d7d2575e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:14.195371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4f3f3-a939-4d76-a56c-620d7d2575e3 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:14.195656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4f3f3-a939-4d76-a56c-620d7d2575e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:14.195930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4f3f3-a939-4d76-a56c-620d7d2575e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:14.206128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4f3f3-a939-4d76-a56c-620d7d2575e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:14.208295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4f3f3-a939-4d76-a56c-620d7d2575e3 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:14.219036 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1131/2261] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:14.245060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012f1d3-57e3-473f-946e-7b552c5d2f7b None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:14.276421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:14.315873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012f1d3-57e3-473f-946e-7b552c5d2f7b None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:14.320698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:14.321345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:14.321893 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:14.322020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] PATH_INFO: `/v3/users/a12f7223d66b4e7597d017986b98db90` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:14.323113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12f7223d66b4e7597d017986b98db90)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:14.323392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee259-95b5-47d2-9a9e-fa78c6336ea8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:14.323687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee259-95b5-47d2-9a9e-fa78c6336ea8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:14.323967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee259-95b5-47d2-9a9e-fa78c6336ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:14.325152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:14.343898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-082ee259-95b5-47d2-9a9e-fa78c6336ea8 None None] MFA Rules not processed for user `37b45e6d825947ce87d70277522964a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:14.345130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-082ee259-95b5-47d2-9a9e-fa78c6336ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:14.402005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1132/2262] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:01:14.511162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12f7223d66b4e7597d017986b98db90'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:14.512175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12f7223d66b4e7597d017986b98db90'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:14.523676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12f7223d66b4e7597d017986b98db90'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:14.594586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12f7223d66b4e7597d017986b98db90'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:14.609987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12f7223d66b4e7597d017986b98db90'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:14.620367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1131/2263] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:14 2022] DELETE /identity/v3/users/a12f7223d66b4e7597d017986b98db90 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:14.622296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef967238-4137-4c78-9686-a3da2152420f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:14.622787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef967238-4137-4c78-9686-a3da2152420f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:14.623316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef967238-4137-4c78-9686-a3da2152420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:14.648987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ef967238-4137-4c78-9686-a3da2152420f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:14.651860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ef967238-4137-4c78-9686-a3da2152420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:14.717683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1133/2264] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:14.730488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:14.734020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:14.797890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731b73-163a-4ee0-837d-3d971f017ce2 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:14.801532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eac483-c834-4cc9-bdf0-16d929dc9627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:14.802164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eac483-c834-4cc9-bdf0-16d929dc9627 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:14.802444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eac483-c834-4cc9-bdf0-16d929dc9627 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:14.802711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eac483-c834-4cc9-bdf0-16d929dc9627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:14.813288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eac483-c834-4cc9-bdf0-16d929dc9627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:14.814780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eac483-c834-4cc9-bdf0-16d929dc9627 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:14.825431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1132/2265] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:15.340355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef967238-4137-4c78-9686-a3da2152420f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:15.343185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ef967238-4137-4c78-9686-a3da2152420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:15.356384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef967238-4137-4c78-9686-a3da2152420f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:15.362309 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:15.362957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:15.363265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:15.366223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] PATH_INFO: `/v3/projects/93b58f88ef4f421bb772237bc50bd8d7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:15.366223 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b58f88ef4f421bb772237bc50bd8d7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:15.367458 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:15.504250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b58f88ef4f421bb772237bc50bd8d7', 'request_id': 'req-073630c0-0bd3-4631-a98d-d8f1d129341c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:15.510790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b58f88ef4f421bb772237bc50bd8d7', 'request_id': 'req-073630c0-0bd3-4631-a98d-d8f1d129341c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:15.606157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b58f88ef4f421bb772237bc50bd8d7', 'request_id': 'req-073630c0-0bd3-4631-a98d-d8f1d129341c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:15.622168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] The token cache is being invalidate because project 93b58f88ef4f421bb772237bc50bd8d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:15.625943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:15.625943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-073630c0-0bd3-4631-a98d-d8f1d129341c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:15.625943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1134/2266] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:15 2022] DELETE /identity/v3/projects/93b58f88ef4f421bb772237bc50bd8d7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:15.629845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed2fc4-ef74-4a43-8b43-08a47b5b8800 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:15.630380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed2fc4-ef74-4a43-8b43-08a47b5b8800 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:15.630479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed2fc4-ef74-4a43-8b43-08a47b5b8800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:15.660963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7fed2fc4-ef74-4a43-8b43-08a47b5b8800 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:15.660963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7fed2fc4-ef74-4a43-8b43-08a47b5b8800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:15.704613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:15.733284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1133/2267] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:15.735716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c991-f70e-49f0-99db-233d29653b0c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:15.736057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c991-f70e-49f0-99db-233d29653b0c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:15.736424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c991-f70e-49f0-99db-233d29653b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:15.759980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:15.767437 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ca84c991-f70e-49f0-99db-233d29653b0c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:15.769705 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ca84c991-f70e-49f0-99db-233d29653b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:15.782419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1135/2268] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:15.786823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed2fc4-ef74-4a43-8b43-08a47b5b8800 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:15.802913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed2fc4-ef74-4a43-8b43-08a47b5b8800 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:15.813213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ba9e-1273-456d-8922-e32fbdd3d60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:15.814449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ba9e-1273-456d-8922-e32fbdd3d60e admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:15.814824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ba9e-1273-456d-8922-e32fbdd3d60e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:15.815052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ba9e-1273-456d-8922-e32fbdd3d60e admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:15.816292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67ba9e-1273-456d-8922-e32fbdd3d60e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:01:15.816587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67ba9e-1273-456d-8922-e32fbdd3d60e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:15.819687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67ba9e-1273-456d-8922-e32fbdd3d60e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:15.839135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1134/2269] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:01:15.840340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84c991-f70e-49f0-99db-233d29653b0c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:15.850529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84c991-f70e-49f0-99db-233d29653b0c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:15.855670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c432ef-f369-40c3-b7da-4b1d31be4828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:15.856296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c432ef-f369-40c3-b7da-4b1d31be4828 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:15.856568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c432ef-f369-40c3-b7da-4b1d31be4828 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:15.856840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c432ef-f369-40c3-b7da-4b1d31be4828 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:15.857472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c432ef-f369-40c3-b7da-4b1d31be4828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:15.859953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c432ef-f369-40c3-b7da-4b1d31be4828 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:15.995844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1136/2270] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:01:15 2022] POST /identity/v3/projects => generated 359 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:16.000672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ba9e-1273-456d-8922-e32fbdd3d60e admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:16.012588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ba9e-1273-456d-8922-e32fbdd3d60e admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:16.096916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb53cb-51bc-47b2-9a20-d82e8b849927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:16.096916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb53cb-51bc-47b2-9a20-d82e8b849927 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:16.096916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb53cb-51bc-47b2-9a20-d82e8b849927 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:16.097397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb53cb-51bc-47b2-9a20-d82e8b849927 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:16.097825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb53cb-51bc-47b2-9a20-d82e8b849927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:16.099845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb53cb-51bc-47b2-9a20-d82e8b849927 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:16.182726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c432ef-f369-40c3-b7da-4b1d31be4828 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:16.184502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-52c432ef-f369-40c3-b7da-4b1d31be4828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:16.222502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1135/2271] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:01:15 2022] POST /identity/v3/users => generated 280 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:16.226170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb53cb-51bc-47b2-9a20-d82e8b849927 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:16.248901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c432ef-f369-40c3-b7da-4b1d31be4828 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:16.251086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb53cb-51bc-47b2-9a20-d82e8b849927 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:16.252698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5a913-2060-408c-9092-434be20bffe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:16.253381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a913-2060-408c-9092-434be20bffe5 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:16.253821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a913-2060-408c-9092-434be20bffe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:16.254101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5a913-2060-408c-9092-434be20bffe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:16.271815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e7b5a913-2060-408c-9092-434be20bffe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:16.272610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69bd06-cc31-4e01-b511-c6502e7baf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:16.273309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69bd06-cc31-4e01-b511-c6502e7baf7b admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:16.273735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69bd06-cc31-4e01-b511-c6502e7baf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:16.273963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69bd06-cc31-4e01-b511-c6502e7baf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:16.274698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69bd06-cc31-4e01-b511-c6502e7baf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:16.276427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69bd06-cc31-4e01-b511-c6502e7baf7b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:16.293613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1136/2272] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:01:16.294629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69bd06-cc31-4e01-b511-c6502e7baf7b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:16.305365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69bd06-cc31-4e01-b511-c6502e7baf7b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:16.320407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f469ae-a5bd-4eff-abe6-b76027e52e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:16.321136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f469ae-a5bd-4eff-abe6-b76027e52e45 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:16.321422 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f469ae-a5bd-4eff-abe6-b76027e52e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:16.321696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f469ae-a5bd-4eff-abe6-b76027e52e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:16.322359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f469ae-a5bd-4eff-abe6-b76027e52e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:16.324315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f469ae-a5bd-4eff-abe6-b76027e52e45 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:16.340791 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1137/2273] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:01:16.357908 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f469ae-a5bd-4eff-abe6-b76027e52e45 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:16.358282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5a913-2060-408c-9092-434be20bffe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:16.358282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5a913-2060-408c-9092-434be20bffe5 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:16.364093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f469ae-a5bd-4eff-abe6-b76027e52e45 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:16.367886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1137/2274] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:01:16.369832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16342f9e-2714-4ead-a8c6-98c158124a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:16.370550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16342f9e-2714-4ead-a8c6-98c158124a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:16.370793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16342f9e-2714-4ead-a8c6-98c158124a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:16.371004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16342f9e-2714-4ead-a8c6-98c158124a00 admin admin] PATH_INFO: `/v3/projects/d2cb18a343394618bdb90241bf81304e/users/f46f69a6ec6b4e6d9d2123b75655d593/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:16.387534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16342f9e-2714-4ead-a8c6-98c158124a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2cb18a343394618bdb90241bf81304e, user_id=f46f69a6ec6b4e6d9d2123b75655d593, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:16.391318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16342f9e-2714-4ead-a8c6-98c158124a00 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:16.482767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1138/2275] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:01:16 2022] PUT /identity/v3/projects/d2cb18a343394618bdb90241bf81304e/users/f46f69a6ec6b4e6d9d2123b75655d593/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:16.494982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df1db3-3e45-4d4c-ada6-7e56059523ad None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:16.495296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df1db3-3e45-4d4c-ada6-7e56059523ad None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:16.495571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df1db3-3e45-4d4c-ada6-7e56059523ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:16.528341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e1df1db3-3e45-4d4c-ada6-7e56059523ad None None] MFA Rules not processed for user `f46f69a6ec6b4e6d9d2123b75655d593`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:16.530206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e1df1db3-3e45-4d4c-ada6-7e56059523ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:16.602207 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1138/2276] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:16.640994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16342f9e-2714-4ead-a8c6-98c158124a00 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:16.646228 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-16342f9e-2714-4ead-a8c6-98c158124a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:16.717161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16342f9e-2714-4ead-a8c6-98c158124a00 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:16.720962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c555ae-2a90-4c24-9e5a-49d80131acaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:16.721569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c555ae-2a90-4c24-9e5a-49d80131acaa service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:16.721847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c555ae-2a90-4c24-9e5a-49d80131acaa service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:16.722118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c555ae-2a90-4c24-9e5a-49d80131acaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:16.731455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c555ae-2a90-4c24-9e5a-49d80131acaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:16.732914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c555ae-2a90-4c24-9e5a-49d80131acaa service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:16.743263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1139/2277] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:16.759856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df1db3-3e45-4d4c-ada6-7e56059523ad None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:16.781438 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:16.829057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df1db3-3e45-4d4c-ada6-7e56059523ad None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:16.834898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:16.835582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:16.835895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:16.836170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] PATH_INFO: `/v3/users/f46f69a6ec6b4e6d9d2123b75655d593` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:16.837326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46f69a6ec6b4e6d9d2123b75655d593)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:16.839354 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:17.110739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46f69a6ec6b4e6d9d2123b75655d593'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:17.111448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46f69a6ec6b4e6d9d2123b75655d593'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:17.217626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46f69a6ec6b4e6d9d2123b75655d593'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:17.228774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46f69a6ec6b4e6d9d2123b75655d593'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:17.243631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46f69a6ec6b4e6d9d2123b75655d593'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:17.249870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1139/2278] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:16 2022] DELETE /identity/v3/users/f46f69a6ec6b4e6d9d2123b75655d593 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:17.254368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bef59-e412-43f5-8129-90b2e7a26346 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:17.254649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bef59-e412-43f5-8129-90b2e7a26346 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:17.254916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bef59-e412-43f5-8129-90b2e7a26346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:17.276552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-515bef59-e412-43f5-8129-90b2e7a26346 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:17.277783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-515bef59-e412-43f5-8129-90b2e7a26346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:17.291137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:17.347459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1140/2279] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:17.359981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:17.366281 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:17.465079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1af5-e770-472d-87cd-764c76d37c70 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:17.468961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077a777-7c68-4b4c-84b6-032d50f1e005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:17.469544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077a777-7c68-4b4c-84b6-032d50f1e005 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:17.469823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077a777-7c68-4b4c-84b6-032d50f1e005 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:17.470087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077a777-7c68-4b4c-84b6-032d50f1e005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:17.479899 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077a777-7c68-4b4c-84b6-032d50f1e005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:17.482475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077a777-7c68-4b4c-84b6-032d50f1e005 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:17.491518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1140/2280] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:18.043892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bef59-e412-43f5-8129-90b2e7a26346 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:18.043892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-515bef59-e412-43f5-8129-90b2e7a26346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:18.059607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bef59-e412-43f5-8129-90b2e7a26346 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:18.080221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:18.080221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:18.080221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:18.080221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] PATH_INFO: `/v3/projects/d2cb18a343394618bdb90241bf81304e` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:18.080654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2cb18a343394618bdb90241bf81304e)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:18.080654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:18.252726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2cb18a343394618bdb90241bf81304e', 'request_id': 'req-6f40ec3e-d9b0-4268-bcae-107010bc049a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:18.271884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2cb18a343394618bdb90241bf81304e', 'request_id': 'req-6f40ec3e-d9b0-4268-bcae-107010bc049a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:18.279937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2cb18a343394618bdb90241bf81304e', 'request_id': 'req-6f40ec3e-d9b0-4268-bcae-107010bc049a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:18.360788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] The token cache is being invalidate because project d2cb18a343394618bdb90241bf81304e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:18.362712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:18.362712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6f40ec3e-d9b0-4268-bcae-107010bc049a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:18.370186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d17a3-73c0-4761-8e67-207e624d815f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:18.371044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d17a3-73c0-4761-8e67-207e624d815f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:18.371627 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d17a3-73c0-4761-8e67-207e624d815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:18.374680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1141/2281] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:18 2022] DELETE /identity/v3/projects/d2cb18a343394618bdb90241bf81304e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:18.406242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-a24d17a3-73c0-4761-8e67-207e624d815f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:18.408032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a24d17a3-73c0-4761-8e67-207e624d815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:18.447123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:18.479707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1141/2282] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:18.488602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd123a9-064f-44c2-99d6-6ef0dc05cd01 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:18.489147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd123a9-064f-44c2-99d6-6ef0dc05cd01 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:18.489633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd123a9-064f-44c2-99d6-6ef0dc05cd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:18.517405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-dfd123a9-064f-44c2-99d6-6ef0dc05cd01 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:18.522550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-dfd123a9-064f-44c2-99d6-6ef0dc05cd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:18.533137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1142/2283] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:18.539418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d17a3-73c0-4761-8e67-207e624d815f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:18.554347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d17a3-73c0-4761-8e67-207e624d815f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:18.568898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bffb3e-42a6-486f-a28f-dba75a22acaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:18.568898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bffb3e-42a6-486f-a28f-dba75a22acaf admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:18.568898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bffb3e-42a6-486f-a28f-dba75a22acaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:18.568898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bffb3e-42a6-486f-a28f-dba75a22acaf admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:18.569348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bffb3e-42a6-486f-a28f-dba75a22acaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:01:18.569348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bffb3e-42a6-486f-a28f-dba75a22acaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:18.569348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bffb3e-42a6-486f-a28f-dba75a22acaf admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:18.593798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd123a9-064f-44c2-99d6-6ef0dc05cd01 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:18.594023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1142/2284] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:01:18.605858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd123a9-064f-44c2-99d6-6ef0dc05cd01 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:18.613359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642c183-32ad-4256-a4fa-456ab451aee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:18.614034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c183-32ad-4256-a4fa-456ab451aee4 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:18.614315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c183-32ad-4256-a4fa-456ab451aee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:18.615289 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c183-32ad-4256-a4fa-456ab451aee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:18.616497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642c183-32ad-4256-a4fa-456ab451aee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:18.618675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642c183-32ad-4256-a4fa-456ab451aee4 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:18.759276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1143/2285] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:01:18 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:18.761338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bffb3e-42a6-486f-a28f-dba75a22acaf admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:18.775481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bffb3e-42a6-486f-a28f-dba75a22acaf admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:18.858072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312150-7a70-45d4-a07e-97df99b88886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:18.858740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312150-7a70-45d4-a07e-97df99b88886 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:18.859073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312150-7a70-45d4-a07e-97df99b88886 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:18.859728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f312150-7a70-45d4-a07e-97df99b88886 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:18.860606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312150-7a70-45d4-a07e-97df99b88886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:18.864322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f312150-7a70-45d4-a07e-97df99b88886 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:18.975146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1143/2286] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:01:18 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:18.979261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642c183-32ad-4256-a4fa-456ab451aee4 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:18.992479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642c183-32ad-4256-a4fa-456ab451aee4 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:19.024363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39175b4d-2411-4b33-90c1-22cc131cc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:19.025197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175b4d-2411-4b33-90c1-22cc131cc53d admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:19.025677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175b4d-2411-4b33-90c1-22cc131cc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:19.025900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175b4d-2411-4b33-90c1-22cc131cc53d admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:19.026700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39175b4d-2411-4b33-90c1-22cc131cc53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:19.028956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39175b4d-2411-4b33-90c1-22cc131cc53d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:19.044327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1144/2287] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:19.047947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312150-7a70-45d4-a07e-97df99b88886 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:19.062144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f312150-7a70-45d4-a07e-97df99b88886 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:19.075056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeacf2c-8a59-4ea0-b499-46a4897e7d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:19.075786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeacf2c-8a59-4ea0-b499-46a4897e7d75 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:19.076139 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeacf2c-8a59-4ea0-b499-46a4897e7d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:19.076485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeacf2c-8a59-4ea0-b499-46a4897e7d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:19.084114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeacf2c-8a59-4ea0-b499-46a4897e7d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:19.086192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeacf2c-8a59-4ea0-b499-46a4897e7d75 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:19.132465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1144/2288] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:19.133552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39175b4d-2411-4b33-90c1-22cc131cc53d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:19.150936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39175b4d-2411-4b33-90c1-22cc131cc53d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:19.166557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ddcea-9436-4d3b-9e5b-b77f59139b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:19.171710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ddcea-9436-4d3b-9e5b-b77f59139b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:19.172039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ddcea-9436-4d3b-9e5b-b77f59139b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:19.174264 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ddcea-9436-4d3b-9e5b-b77f59139b6d admin admin] PATH_INFO: `/v3/projects/f34b4acfa22a406d8b4c69687f5d66d4/users/fcf69e962d7842acb6f9b9433169ada1/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:19.215424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ddcea-9436-4d3b-9e5b-b77f59139b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34b4acfa22a406d8b4c69687f5d66d4, user_id=fcf69e962d7842acb6f9b9433169ada1, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:19.218911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ddcea-9436-4d3b-9e5b-b77f59139b6d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:19.357624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1145/2289] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:01:19 2022] PUT /identity/v3/projects/f34b4acfa22a406d8b4c69687f5d66d4/users/fcf69e962d7842acb6f9b9433169ada1/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:19.364625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f858c5b-6c0f-44bc-9e2c-dbe64bae74d2 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:19.365130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f858c5b-6c0f-44bc-9e2c-dbe64bae74d2 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:19.365850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f858c5b-6c0f-44bc-9e2c-dbe64bae74d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:19.390307 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7f858c5b-6c0f-44bc-9e2c-dbe64bae74d2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:19.393057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7f858c5b-6c0f-44bc-9e2c-dbe64bae74d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:19.480012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1145/2290] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:19.486287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ddcea-9436-4d3b-9e5b-b77f59139b6d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:19.488421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-149ddcea-9436-4d3b-9e5b-b77f59139b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:19.549250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:19.575811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ddcea-9436-4d3b-9e5b-b77f59139b6d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:19.581459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f07b04-6017-4df2-b731-0146917718c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:19.582255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f07b04-6017-4df2-b731-0146917718c7 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:19.582618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f07b04-6017-4df2-b731-0146917718c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:19.582965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f07b04-6017-4df2-b731-0146917718c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:19.598736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f07b04-6017-4df2-b731-0146917718c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:19.601474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f07b04-6017-4df2-b731-0146917718c7 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:19.635208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1146/2291] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:21.175216 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673b1e-1a8b-4736-90a2-f28c9b5a6c72 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:21.176183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673b1e-1a8b-4736-90a2-f28c9b5a6c72 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:21.176626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673b1e-1a8b-4736-90a2-f28c9b5a6c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:21.214722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0c673b1e-1a8b-4736-90a2-f28c9b5a6c72 None None] MFA Rules not processed for user `fcf69e962d7842acb6f9b9433169ada1`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:21.216708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0c673b1e-1a8b-4736-90a2-f28c9b5a6c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:21.260709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:21.313884 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1146/2292] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:21.328114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f07b04-6017-4df2-b731-0146917718c7 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:21.328114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-98f07b04-6017-4df2-b731-0146917718c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:21.386582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f07b04-6017-4df2-b731-0146917718c7 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:21.390266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e65066-aeb9-468a-a9a8-a72bfe2f3fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:21.390830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e65066-aeb9-468a-a9a8-a72bfe2f3fde service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:21.391108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e65066-aeb9-468a-a9a8-a72bfe2f3fde service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:21.391451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e65066-aeb9-468a-a9a8-a72bfe2f3fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:21.400721 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e65066-aeb9-468a-a9a8-a72bfe2f3fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:21.402168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e65066-aeb9-468a-a9a8-a72bfe2f3fde service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:21.413016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1147/2293] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:23.324490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe664-621a-4fff-b9a1-ab081e2b9f38 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:23.324972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe664-621a-4fff-b9a1-ab081e2b9f38 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:23.325074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe664-621a-4fff-b9a1-ab081e2b9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:23.345499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-807fe664-621a-4fff-b9a1-ab081e2b9f38 None None] MFA Rules not processed for user `fcf69e962d7842acb6f9b9433169ada1`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:23.346774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-807fe664-621a-4fff-b9a1-ab081e2b9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:23.353733 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1147/2294] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:25.946585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e65066-aeb9-468a-a9a8-a72bfe2f3fde service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:25.948215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-51e65066-aeb9-468a-a9a8-a72bfe2f3fde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:25.963179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e65066-aeb9-468a-a9a8-a72bfe2f3fde service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:25.967789 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:25.970541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:25.970541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:25.970541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] PATH_INFO: `/v3/users/8419b1cfcc684060a780e2d87058144c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:25.970541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8419b1cfcc684060a780e2d87058144c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:25.972013 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:26.212838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8419b1cfcc684060a780e2d87058144c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:26.213558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8419b1cfcc684060a780e2d87058144c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:26.221525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8419b1cfcc684060a780e2d87058144c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:26.283018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8419b1cfcc684060a780e2d87058144c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:26.299736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8419b1cfcc684060a780e2d87058144c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:26.306583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1148/2295] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:25 2022] DELETE /identity/v3/users/8419b1cfcc684060a780e2d87058144c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:26.310962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496054ad-473e-42f1-a4c5-f89fe6bc151e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:26.311923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496054ad-473e-42f1-a4c5-f89fe6bc151e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:26.312205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496054ad-473e-42f1-a4c5-f89fe6bc151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:26.332017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-496054ad-473e-42f1-a4c5-f89fe6bc151e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:26.333198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-496054ad-473e-42f1-a4c5-f89fe6bc151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:26.404219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1148/2296] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:26.415014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:26.416453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:26.480191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cd1d9-3c81-490d-bcf9-0de30039066b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:26.483945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf93d5e-1cae-42d3-a943-7a86010c89c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:26.484840 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf93d5e-1cae-42d3-a943-7a86010c89c6 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:26.485102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf93d5e-1cae-42d3-a943-7a86010c89c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:26.485371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf93d5e-1cae-42d3-a943-7a86010c89c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:26.497560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf93d5e-1cae-42d3-a943-7a86010c89c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:26.499436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf93d5e-1cae-42d3-a943-7a86010c89c6 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:26.503650 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:26.511059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1149/2297] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:27.035935 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496054ad-473e-42f1-a4c5-f89fe6bc151e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:27.038343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-496054ad-473e-42f1-a4c5-f89fe6bc151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:27.055091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496054ad-473e-42f1-a4c5-f89fe6bc151e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:27.059821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:27.060460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:27.060735 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:27.061006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] PATH_INFO: `/v3/projects/ca213e0d48ae4f3fa087bc35e851d080` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:27.062155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca213e0d48ae4f3fa087bc35e851d080)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:27.064123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:27.193649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca213e0d48ae4f3fa087bc35e851d080', 'request_id': 'req-4cdadaba-2706-4186-ba1b-fa027d15a151'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:27.199897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca213e0d48ae4f3fa087bc35e851d080', 'request_id': 'req-4cdadaba-2706-4186-ba1b-fa027d15a151'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:27.296834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca213e0d48ae4f3fa087bc35e851d080', 'request_id': 'req-4cdadaba-2706-4186-ba1b-fa027d15a151'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:27.309937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] The token cache is being invalidate because project ca213e0d48ae4f3fa087bc35e851d080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:27.310286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:27.311005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4cdadaba-2706-4186-ba1b-fa027d15a151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:27.312801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1149/2298] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:27 2022] DELETE /identity/v3/projects/ca213e0d48ae4f3fa087bc35e851d080 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:27.318624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08a23-7bf8-4344-94fd-318ea0e3be9f None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:27.319129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08a23-7bf8-4344-94fd-318ea0e3be9f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:27.319256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f08a23-7bf8-4344-94fd-318ea0e3be9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:27.340738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-07f08a23-7bf8-4344-94fd-318ea0e3be9f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:27.341922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-07f08a23-7bf8-4344-94fd-318ea0e3be9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:27.444100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1150/2299] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:27.447106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663540-aedc-4356-bda8-c4522bc7eb7f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:27.447514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663540-aedc-4356-bda8-c4522bc7eb7f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:27.448040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20663540-aedc-4356-bda8-c4522bc7eb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:27.483855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-20663540-aedc-4356-bda8-c4522bc7eb7f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:27.485719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-20663540-aedc-4356-bda8-c4522bc7eb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:27.507608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1150/2300] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:27.512155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f08a23-7bf8-4344-94fd-318ea0e3be9f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:27.522997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f08a23-7bf8-4344-94fd-318ea0e3be9f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:27.528070 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b11e-3a18-4267-8b84-d7d0d3ae9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:27.528695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b11e-3a18-4267-8b84-d7d0d3ae9d24 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:27.529170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b11e-3a18-4267-8b84-d7d0d3ae9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:27.529582 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b11e-3a18-4267-8b84-d7d0d3ae9d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:27.531093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8b11e-3a18-4267-8b84-d7d0d3ae9d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:01:27.531093 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8b11e-3a18-4267-8b84-d7d0d3ae9d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:27.532352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8b11e-3a18-4267-8b84-d7d0d3ae9d24 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:27.549113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1151/2301] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:01:27.559346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663540-aedc-4356-bda8-c4522bc7eb7f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:27.570073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20663540-aedc-4356-bda8-c4522bc7eb7f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:27.575359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5937bb-971a-4ded-97ba-3df478a9ec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:27.575976 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5937bb-971a-4ded-97ba-3df478a9ec08 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:27.576265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5937bb-971a-4ded-97ba-3df478a9ec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:27.576568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5937bb-971a-4ded-97ba-3df478a9ec08 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:27.577171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5937bb-971a-4ded-97ba-3df478a9ec08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:27.579129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5937bb-971a-4ded-97ba-3df478a9ec08 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:27.687427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1151/2302] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:01:27 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:27.691563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b11e-3a18-4267-8b84-d7d0d3ae9d24 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:27.706873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b11e-3a18-4267-8b84-d7d0d3ae9d24 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:27.788559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8eaa4f-2383-44c5-8fdd-112869305535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:27.789559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eaa4f-2383-44c5-8fdd-112869305535 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:27.790000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eaa4f-2383-44c5-8fdd-112869305535 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:27.790461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eaa4f-2383-44c5-8fdd-112869305535 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:27.791297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8eaa4f-2383-44c5-8fdd-112869305535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:27.794421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8eaa4f-2383-44c5-8fdd-112869305535 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:27.916194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1152/2303] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:01:27 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:01:27.920143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5937bb-971a-4ded-97ba-3df478a9ec08 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:27.931836 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5937bb-971a-4ded-97ba-3df478a9ec08 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:27.936833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9645a34-ada9-4b93-be6b-06279f7e050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:27.937438 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9645a34-ada9-4b93-be6b-06279f7e050f admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:27.937714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9645a34-ada9-4b93-be6b-06279f7e050f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:27.937982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9645a34-ada9-4b93-be6b-06279f7e050f admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:27.938662 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9645a34-ada9-4b93-be6b-06279f7e050f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:27.940568 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9645a34-ada9-4b93-be6b-06279f7e050f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:27.953138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1152/2304] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:27.957469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8eaa4f-2383-44c5-8fdd-112869305535 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:27.969124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8eaa4f-2383-44c5-8fdd-112869305535 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:27.973774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0411086-1d96-4b76-8154-2365324a5d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:27.976107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411086-1d96-4b76-8154-2365324a5d6f admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:27.976107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411086-1d96-4b76-8154-2365324a5d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:27.976107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411086-1d96-4b76-8154-2365324a5d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:27.976107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0411086-1d96-4b76-8154-2365324a5d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:27.977713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0411086-1d96-4b76-8154-2365324a5d6f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:27.989073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1153/2305] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:27.993966 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9645a34-ada9-4b93-be6b-06279f7e050f admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:28.004323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9645a34-ada9-4b93-be6b-06279f7e050f admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:28.008906 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef581ebe-4413-4eb4-848a-52b14e19dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:28.009555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef581ebe-4413-4eb4-848a-52b14e19dab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:28.009839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef581ebe-4413-4eb4-848a-52b14e19dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:28.010109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef581ebe-4413-4eb4-848a-52b14e19dab9 admin admin] PATH_INFO: `/v3/projects/1f3bf8b67c3e4b2aaa48a5cafee53835/users/da22afecb0964dde9b8f711db62f90b8/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:28.022505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:28.026572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef581ebe-4413-4eb4-848a-52b14e19dab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3bf8b67c3e4b2aaa48a5cafee53835, user_id=da22afecb0964dde9b8f711db62f90b8, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:28.029362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef581ebe-4413-4eb4-848a-52b14e19dab9 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:28.128628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1153/2306] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:01:27 2022] PUT /identity/v3/projects/1f3bf8b67c3e4b2aaa48a5cafee53835/users/da22afecb0964dde9b8f711db62f90b8/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:28.139307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597fa57-8ed7-4cf3-b927-d40917222916 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:28.139593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597fa57-8ed7-4cf3-b927-d40917222916 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:28.139867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597fa57-8ed7-4cf3-b927-d40917222916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:28.169717 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-3597fa57-8ed7-4cf3-b927-d40917222916 None None] MFA Rules not processed for user `da22afecb0964dde9b8f711db62f90b8`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:28.170841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3597fa57-8ed7-4cf3-b927-d40917222916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:28.227694 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:28.238765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1154/2307] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:28.251910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef581ebe-4413-4eb4-848a-52b14e19dab9 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:28.253629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ef581ebe-4413-4eb4-848a-52b14e19dab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:28.319948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef581ebe-4413-4eb4-848a-52b14e19dab9 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:28.324678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bcfa2-d69a-46f0-b659-d0577a5a1b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:28.325312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bcfa2-d69a-46f0-b659-d0577a5a1b40 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:28.331451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bcfa2-d69a-46f0-b659-d0577a5a1b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:28.331451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bcfa2-d69a-46f0-b659-d0577a5a1b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:28.339809 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bcfa2-d69a-46f0-b659-d0577a5a1b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:28.341468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bcfa2-d69a-46f0-b659-d0577a5a1b40 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:28.353490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1154/2308] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:33.616091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597fa57-8ed7-4cf3-b927-d40917222916 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:33.618130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3597fa57-8ed7-4cf3-b927-d40917222916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:33.718850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597fa57-8ed7-4cf3-b927-d40917222916 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:33.723729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:33.725061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:33.725407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:33.725757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] PATH_INFO: `/v3/users/638505c8b58740bfb4e89a6021ec58cc` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:33.727162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=638505c8b58740bfb4e89a6021ec58cc)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:33.729245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:33.985555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638505c8b58740bfb4e89a6021ec58cc'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:33.986210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638505c8b58740bfb4e89a6021ec58cc'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:33.993524 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638505c8b58740bfb4e89a6021ec58cc'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:34.056953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638505c8b58740bfb4e89a6021ec58cc'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:34.072039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638505c8b58740bfb4e89a6021ec58cc'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:34.078744 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1155/2309] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:33 2022] DELETE /identity/v3/users/638505c8b58740bfb4e89a6021ec58cc => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:01:34.083129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce7116-c27e-455a-9e8c-1f456c9ed72f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:34.084321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce7116-c27e-455a-9e8c-1f456c9ed72f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:34.084321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce7116-c27e-455a-9e8c-1f456c9ed72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:34.104749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-61ce7116-c27e-455a-9e8c-1f456c9ed72f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:34.106365 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-61ce7116-c27e-455a-9e8c-1f456c9ed72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:34.168402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1155/2310] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:34.179060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:34.180781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:34.246030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17880c-2243-4488-aa42-c6860d5eea35 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:34.249690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fa154-3be9-4fee-bcbf-6a2a11e4debe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:34.250394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fa154-3be9-4fee-bcbf-6a2a11e4debe service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:34.250677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fa154-3be9-4fee-bcbf-6a2a11e4debe service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:34.250942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fa154-3be9-4fee-bcbf-6a2a11e4debe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:34.260873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fa154-3be9-4fee-bcbf-6a2a11e4debe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:34.262393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fa154-3be9-4fee-bcbf-6a2a11e4debe service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:34.275805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1156/2311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:34.675964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce7116-c27e-455a-9e8c-1f456c9ed72f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:34.677690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-61ce7116-c27e-455a-9e8c-1f456c9ed72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:34.701830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce7116-c27e-455a-9e8c-1f456c9ed72f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:34.710336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:34.710336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:34.710336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:34.710336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] PATH_INFO: `/v3/projects/16aabddcd6d943008d838c7990011c15` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:34.711061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16aabddcd6d943008d838c7990011c15)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:34.711824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:34.845479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16aabddcd6d943008d838c7990011c15', 'request_id': 'req-f274a352-8585-458b-a419-60fd94d4e043'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:34.853002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16aabddcd6d943008d838c7990011c15', 'request_id': 'req-f274a352-8585-458b-a419-60fd94d4e043'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:34.951024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16aabddcd6d943008d838c7990011c15', 'request_id': 'req-f274a352-8585-458b-a419-60fd94d4e043'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:34.962955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] The token cache is being invalidate because project 16aabddcd6d943008d838c7990011c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:34.963275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:34.963920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f274a352-8585-458b-a419-60fd94d4e043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:34.965404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1156/2312] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:34 2022] DELETE /identity/v3/projects/16aabddcd6d943008d838c7990011c15 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:34.970314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edd0f-c03b-4b8f-a545-fff3af48062a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:34.970829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edd0f-c03b-4b8f-a545-fff3af48062a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:34.970924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edd0f-c03b-4b8f-a545-fff3af48062a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:34.992346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-468edd0f-c03b-4b8f-a545-fff3af48062a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:34.995547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-468edd0f-c03b-4b8f-a545-fff3af48062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:35.004178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:35.058760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1157/2313] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:35.067628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28967568-7149-4d62-9932-08228f6641e2 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.068457 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28967568-7149-4d62-9932-08228f6641e2 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.068728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28967568-7149-4d62-9932-08228f6641e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.090507 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-28967568-7149-4d62-9932-08228f6641e2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:35.091765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-28967568-7149-4d62-9932-08228f6641e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:35.104050 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1157/2314] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:35.108432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edd0f-c03b-4b8f-a545-fff3af48062a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:35.121164 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edd0f-c03b-4b8f-a545-fff3af48062a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:35.126461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bbcaa-5fca-4c3a-9d8d-17c6063af45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:35.127079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbcaa-5fca-4c3a-9d8d-17c6063af45a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.127391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbcaa-5fca-4c3a-9d8d-17c6063af45a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.127658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bbcaa-5fca-4c3a-9d8d-17c6063af45a admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.128314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bbcaa-5fca-4c3a-9d8d-17c6063af45a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:01:35.128609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bbcaa-5fca-4c3a-9d8d-17c6063af45a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:35.143560 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bbcaa-5fca-4c3a-9d8d-17c6063af45a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:35.148764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1158/2315] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:01:35.149878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28967568-7149-4d62-9932-08228f6641e2 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:35.159594 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28967568-7149-4d62-9932-08228f6641e2 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:35.165664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187ac32-83d7-4f44-99eb-85e194bdd70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:35.166277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187ac32-83d7-4f44-99eb-85e194bdd70c admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.166581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187ac32-83d7-4f44-99eb-85e194bdd70c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.166848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187ac32-83d7-4f44-99eb-85e194bdd70c admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.167673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187ac32-83d7-4f44-99eb-85e194bdd70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:35.169625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187ac32-83d7-4f44-99eb-85e194bdd70c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:35.175262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:35.266767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1158/2316] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:01:35 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:01:35.271468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bbcaa-5fca-4c3a-9d8d-17c6063af45a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:35.281480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bbcaa-5fca-4c3a-9d8d-17c6063af45a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:35.342406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39536-ee30-433c-9003-73578813fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:35.343017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39536-ee30-433c-9003-73578813fa6f admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.343324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39536-ee30-433c-9003-73578813fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.343695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39536-ee30-433c-9003-73578813fa6f admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.344347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f39536-ee30-433c-9003-73578813fa6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:35.346334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f39536-ee30-433c-9003-73578813fa6f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:35.431602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1159/2317] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:01:35 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:01:35.494158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187ac32-83d7-4f44-99eb-85e194bdd70c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:35.504927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187ac32-83d7-4f44-99eb-85e194bdd70c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:35.509945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b4250-ff4a-4e79-9750-582569598863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:35.510556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b4250-ff4a-4e79-9750-582569598863 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.510835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b4250-ff4a-4e79-9750-582569598863 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.511106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b4250-ff4a-4e79-9750-582569598863 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.511790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b4250-ff4a-4e79-9750-582569598863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:35.513489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b4250-ff4a-4e79-9750-582569598863 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:35.524169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1159/2318] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:35.529642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39536-ee30-433c-9003-73578813fa6f admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:35.540624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39536-ee30-433c-9003-73578813fa6f admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:35.545334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ea07-f831-4e99-99a2-e11850a8f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:35.545975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ea07-f831-4e99-99a2-e11850a8f7fa admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.546235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ea07-f831-4e99-99a2-e11850a8f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.546473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69ea07-f831-4e99-99a2-e11850a8f7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.547120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69ea07-f831-4e99-99a2-e11850a8f7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:35.551940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69ea07-f831-4e99-99a2-e11850a8f7fa admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:35.553256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b4250-ff4a-4e79-9750-582569598863 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:35.554936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-113b4250-ff4a-4e79-9750-582569598863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:35.564502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1160/2319] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:01:35.568719 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ea07-f831-4e99-99a2-e11850a8f7fa admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:35.572017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b4250-ff4a-4e79-9750-582569598863 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:35.577013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:35.577648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.577928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.578281 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] PATH_INFO: `/v3/users/da22afecb0964dde9b8f711db62f90b8` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.578639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69ea07-f831-4e99-99a2-e11850a8f7fa admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:35.579572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da22afecb0964dde9b8f711db62f90b8)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:35.581579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:35.583707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241a31b-99a6-41f8-bb6e-22818cb8b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:35.584449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a31b-99a6-41f8-bb6e-22818cb8b1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.584712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a31b-99a6-41f8-bb6e-22818cb8b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.584981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241a31b-99a6-41f8-bb6e-22818cb8b1fd admin admin] PATH_INFO: `/v3/projects/d11f64420fd24dba87d769cea80b7623/users/af662d9d61b446aa9b8dfe771eca8e8e/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.602033 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a31b-99a6-41f8-bb6e-22818cb8b1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11f64420fd24dba87d769cea80b7623, user_id=af662d9d61b446aa9b8dfe771eca8e8e, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:35.604932 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241a31b-99a6-41f8-bb6e-22818cb8b1fd admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:35.691286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1161/2320] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:01:35 2022] PUT /identity/v3/projects/d11f64420fd24dba87d769cea80b7623/users/af662d9d61b446aa9b8dfe771eca8e8e/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:01:35.701226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47247-82e1-48c6-9787-523d9602f2de None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.701533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47247-82e1-48c6-9787-523d9602f2de None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.701801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec47247-82e1-48c6-9787-523d9602f2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.731284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-eec47247-82e1-48c6-9787-523d9602f2de None None] MFA Rules not processed for user `af662d9d61b446aa9b8dfe771eca8e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:35.732515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-eec47247-82e1-48c6-9787-523d9602f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:35.781023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:35.806336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da22afecb0964dde9b8f711db62f90b8'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:35.806565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1162/2321] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:01:35.806654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da22afecb0964dde9b8f711db62f90b8'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:35.815248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47247-82e1-48c6-9787-523d9602f2de None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:35.816759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-eec47247-82e1-48c6-9787-523d9602f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:35.886334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec47247-82e1-48c6-9787-523d9602f2de None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:35.890219 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d4d47-dd79-401b-958c-dcd93d1fb72c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:35.892332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4d47-dd79-401b-958c-dcd93d1fb72c service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.892332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4d47-dd79-401b-958c-dcd93d1fb72c service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.892332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d4d47-dd79-401b-958c-dcd93d1fb72c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.893186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a91d4d47-dd79-401b-958c-dcd93d1fb72c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:35.905642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d4d47-dd79-401b-958c-dcd93d1fb72c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:35.907102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d4d47-dd79-401b-958c-dcd93d1fb72c service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:35.910800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da22afecb0964dde9b8f711db62f90b8'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:35.919693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da22afecb0964dde9b8f711db62f90b8'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:35.920798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1163/2322] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:01:35.933682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da22afecb0964dde9b8f711db62f90b8'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:35.942367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1160/2323] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:35 2022] DELETE /identity/v3/users/da22afecb0964dde9b8f711db62f90b8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:01:35.948282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:35.948470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44c341-1b28-4890-aa15-bccb40fbda8d None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:35.948691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44c341-1b28-4890-aa15-bccb40fbda8d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:35.948895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44c341-1b28-4890-aa15-bccb40fbda8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:35.949950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:35.969482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8c44c341-1b28-4890-aa15-bccb40fbda8d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:35.970758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8c44c341-1b28-4890-aa15-bccb40fbda8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:36.047488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43df57d-eaa4-4ac5-970e-7b8e2e546c69 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:36.060617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:36.061934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:36.062226 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:36.062504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] PATH_INFO: `/v3/users/af662d9d61b446aa9b8dfe771eca8e8e` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:36.064245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af662d9d61b446aa9b8dfe771eca8e8e)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:36.068333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:36.074698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1164/2324] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:36.096890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44c341-1b28-4890-aa15-bccb40fbda8d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:36.105510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8c44c341-1b28-4890-aa15-bccb40fbda8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:36.186494 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44c341-1b28-4890-aa15-bccb40fbda8d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:36.201565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95556ca-8fe2-431c-b0de-d76722ac94bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:36.202675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95556ca-8fe2-431c-b0de-d76722ac94bb service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:36.203084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95556ca-8fe2-431c-b0de-d76722ac94bb service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:36.203492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95556ca-8fe2-431c-b0de-d76722ac94bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:36.245332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95556ca-8fe2-431c-b0de-d76722ac94bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:36.246836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95556ca-8fe2-431c-b0de-d76722ac94bb service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:36.262390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1165/2325] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:01:36.312339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af662d9d61b446aa9b8dfe771eca8e8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:36.314512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af662d9d61b446aa9b8dfe771eca8e8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:36.318909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:36.445297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af662d9d61b446aa9b8dfe771eca8e8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:36.468530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af662d9d61b446aa9b8dfe771eca8e8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:36.489931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af662d9d61b446aa9b8dfe771eca8e8e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:36.497974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1161/2326] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:01:35 2022] DELETE /identity/v3/users/af662d9d61b446aa9b8dfe771eca8e8e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:36.502547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c42d-2825-43db-9bcb-297952c3831e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:36.502839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c42d-2825-43db-9bcb-297952c3831e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:36.503112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020c42d-2825-43db-9bcb-297952c3831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:36.527442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-d020c42d-2825-43db-9bcb-297952c3831e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:36.528815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d020c42d-2825-43db-9bcb-297952c3831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:36.584088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:36.622616 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1166/2327] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:01:36.636896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:36.638741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:36.710537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c5704-eb63-4548-b456-ed497eccaea5 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:36.714447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592f64d-52bf-41fa-9678-58b781e4616a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:36.715069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f64d-52bf-41fa-9678-58b781e4616a service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:36.715458 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f64d-52bf-41fa-9678-58b781e4616a service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:36.715729 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f64d-52bf-41fa-9678-58b781e4616a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:36.727536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592f64d-52bf-41fa-9678-58b781e4616a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:36.729195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592f64d-52bf-41fa-9678-58b781e4616a service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:36.740692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1162/2328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:01:36.845036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020c42d-2825-43db-9bcb-297952c3831e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:36.845036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d020c42d-2825-43db-9bcb-297952c3831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:36.860552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020c42d-2825-43db-9bcb-297952c3831e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:36.888057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:36.888720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:36.888995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:36.889266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] PATH_INFO: `/v3/projects/1f3bf8b67c3e4b2aaa48a5cafee53835` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:36.890448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f3bf8b67c3e4b2aaa48a5cafee53835)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:36.892406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:37.044437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f3bf8b67c3e4b2aaa48a5cafee53835', 'request_id': 'req-08e65419-c2ce-4569-8c6e-4b6c96f264f6'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.053649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f3bf8b67c3e4b2aaa48a5cafee53835', 'request_id': 'req-08e65419-c2ce-4569-8c6e-4b6c96f264f6'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.063687 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f3bf8b67c3e4b2aaa48a5cafee53835', 'request_id': 'req-08e65419-c2ce-4569-8c6e-4b6c96f264f6'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.134173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] The token cache is being invalidate because project 1f3bf8b67c3e4b2aaa48a5cafee53835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:37.134519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.135294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08e65419-c2ce-4569-8c6e-4b6c96f264f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.136794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1167/2329] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:36 2022] DELETE /identity/v3/projects/1f3bf8b67c3e4b2aaa48a5cafee53835 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:37.273542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592f64d-52bf-41fa-9678-58b781e4616a service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:01:37.275610 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3592f64d-52bf-41fa-9678-58b781e4616a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:37.296581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592f64d-52bf-41fa-9678-58b781e4616a service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:01:37.360821 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:01:37.361490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:37.361643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:37.361915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] PATH_INFO: `/v3/projects/d11f64420fd24dba87d769cea80b7623` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:37.363037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11f64420fd24dba87d769cea80b7623)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:01:37.365528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:01:37.467987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11f64420fd24dba87d769cea80b7623', 'request_id': 'req-51118c2c-4532-4b0a-aa8b-9642203818bb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.475503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11f64420fd24dba87d769cea80b7623', 'request_id': 'req-51118c2c-4532-4b0a-aa8b-9642203818bb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.562563 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11f64420fd24dba87d769cea80b7623', 'request_id': 'req-51118c2c-4532-4b0a-aa8b-9642203818bb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.571621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:37.575554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] The token cache is being invalidate because project d11f64420fd24dba87d769cea80b7623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:01:37.575848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.576541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-51118c2c-4532-4b0a-aa8b-9642203818bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:01:37.578228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1163/2330] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:01:37 2022] DELETE /identity/v3/projects/d11f64420fd24dba87d769cea80b7623 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:01:40.181143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6055c2-5296-4b19-9e60-b2246ad2ee02 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:40.181143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6055c2-5296-4b19-9e60-b2246ad2ee02 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:40.181143 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6055c2-5296-4b19-9e60-b2246ad2ee02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:40.190691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c933a-1ebf-4509-926c-c3ce96cce0c8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:01:40.191182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c933a-1ebf-4509-926c-c3ce96cce0c8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:01:40.191291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c933a-1ebf-4509-926c-c3ce96cce0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:01:40.198407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fc6055c2-5296-4b19-9e60-b2246ad2ee02 None None] MFA Rules not processed for user `37b45e6d825947ce87d70277522964a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:40.199723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fc6055c2-5296-4b19-9e60-b2246ad2ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:40.211474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0b6c933a-1ebf-4509-926c-c3ce96cce0c8 None None] MFA Rules not processed for user `49fc8627822f4765b08db422e7e580df`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:01:40.212684 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0b6c933a-1ebf-4509-926c-c3ce96cce0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:01:40.259940 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1168/2331] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:01:40.268631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1164/2332] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:01:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:01:50.252749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=64,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:01:50.261599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=25 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:07.069500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6055c2-5296-4b19-9e60-b2246ad2ee02 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:07.071136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fc6055c2-5296-4b19-9e60-b2246ad2ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:07.167460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6055c2-5296-4b19-9e60-b2246ad2ee02 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:07.173460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:07.174094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:07.174376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:07.174651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:07.176811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:07.193051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:07.195162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:07.210521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1169/2333] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:02:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:02:12.638833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea7ba-2876-4e17-b142-293ba9f25191 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:12.639445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea7ba-2876-4e17-b142-293ba9f25191 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:12.639445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ea7ba-2876-4e17-b142-293ba9f25191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:12.776526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-113ea7ba-2876-4e17-b142-293ba9f25191 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:12.778497 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-113ea7ba-2876-4e17-b142-293ba9f25191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:12.853383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1165/2334] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 20:02:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:12.903973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:12.907292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:13.006680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e861de-6942-44a4-8a32-8336cfe79967 service placement] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:13.015366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6347605-ba5a-45c5-8021-5908006409f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:13.015366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6347605-ba5a-45c5-8021-5908006409f7 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:13.015366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6347605-ba5a-45c5-8021-5908006409f7 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:13.015366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6347605-ba5a-45c5-8021-5908006409f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:13.025437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6347605-ba5a-45c5-8021-5908006409f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:13.027210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6347605-ba5a-45c5-8021-5908006409f7 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:13.037078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1170/2335] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:02:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:02:16.615217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255255a5-247f-4940-923c-c6ef089c3ab6 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:16.616919 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255255a5-247f-4940-923c-c6ef089c3ab6 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:16.616919 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255255a5-247f-4940-923c-c6ef089c3ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:16.647329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-255255a5-247f-4940-923c-c6ef089c3ab6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:16.648337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-255255a5-247f-4940-923c-c6ef089c3ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:16.729753 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1166/2336] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:16.752367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6347605-ba5a-45c5-8021-5908006409f7 service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:16.760820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e6347605-ba5a-45c5-8021-5908006409f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:16.898031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6347605-ba5a-45c5-8021-5908006409f7 service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:16.908880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114c526-4a94-4f76-9578-320177b3b811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:16.911649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114c526-4a94-4f76-9578-320177b3b811 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:16.912340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114c526-4a94-4f76-9578-320177b3b811 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:16.912967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114c526-4a94-4f76-9578-320177b3b811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:16.926438 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114c526-4a94-4f76-9578-320177b3b811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:16.929829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114c526-4a94-4f76-9578-320177b3b811 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:16.952056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1171/2337] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:02:23.359910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a91ab-824b-4fd6-9b77-1a80e7483d96 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:23.361228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a91ab-824b-4fd6-9b77-1a80e7483d96 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:23.361732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a91ab-824b-4fd6-9b77-1a80e7483d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:23.398636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0a4a91ab-824b-4fd6-9b77-1a80e7483d96 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:23.400846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0a4a91ab-824b-4fd6-9b77-1a80e7483d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:23.416813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1167/2338] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:23.436749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114c526-4a94-4f76-9578-320177b3b811 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:23.448277 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:23.458420 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114c526-4a94-4f76-9578-320177b3b811 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:23.468585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852c01-a8ab-4ecf-b952-5e8755796500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:23.469209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852c01-a8ab-4ecf-b952-5e8755796500 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:23.469484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852c01-a8ab-4ecf-b952-5e8755796500 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:23.469860 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852c01-a8ab-4ecf-b952-5e8755796500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:23.483903 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed852c01-a8ab-4ecf-b952-5e8755796500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:23.487667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed852c01-a8ab-4ecf-b952-5e8755796500 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:23.506967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1172/2339] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:02:27.860434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a7e5-d2d1-47b8-b0a1-4b73966b334b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:27.861094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a7e5-d2d1-47b8-b0a1-4b73966b334b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:27.861528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6a7e5-d2d1-47b8-b0a1-4b73966b334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:27.892773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8bd6a7e5-d2d1-47b8-b0a1-4b73966b334b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:27.894549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8bd6a7e5-d2d1-47b8-b0a1-4b73966b334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:27.910201 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1168/2340] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:27.927319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852c01-a8ab-4ecf-b952-5e8755796500 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:27.929243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ed852c01-a8ab-4ecf-b952-5e8755796500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:27.949286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852c01-a8ab-4ecf-b952-5e8755796500 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:27.955584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97c09b-9453-4863-95fb-f6aaef9e0c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:27.956244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97c09b-9453-4863-95fb-f6aaef9e0c0c service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:27.956523 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97c09b-9453-4863-95fb-f6aaef9e0c0c service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:27.957018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97c09b-9453-4863-95fb-f6aaef9e0c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:27.970099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97c09b-9453-4863-95fb-f6aaef9e0c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:27.972061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97c09b-9453-4863-95fb-f6aaef9e0c0c service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:27.987621 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1173/2341] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:02:31.399317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56951c7-429b-4def-9446-c0f275055ab4 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:31.399317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56951c7-429b-4def-9446-c0f275055ab4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:31.399851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56951c7-429b-4def-9446-c0f275055ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:31.426784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f56951c7-429b-4def-9446-c0f275055ab4 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:31.429002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f56951c7-429b-4def-9446-c0f275055ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:31.438470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1169/2342] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 20:02:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:31.456217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97c09b-9453-4863-95fb-f6aaef9e0c0c service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:31.472371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97c09b-9453-4863-95fb-f6aaef9e0c0c service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:31.481322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b44da7-7b24-4fee-9dfe-f7e303caf940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:31.482229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b44da7-7b24-4fee-9dfe-f7e303caf940 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:31.482509 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b44da7-7b24-4fee-9dfe-f7e303caf940 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:31.482778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b44da7-7b24-4fee-9dfe-f7e303caf940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:31.493417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b44da7-7b24-4fee-9dfe-f7e303caf940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:31.495076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b44da7-7b24-4fee-9dfe-f7e303caf940 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:31.505140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1174/2343] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:02:32.821092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0c2f9-41ca-44c9-b8dc-17ae0a569230 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:32.821612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0c2f9-41ca-44c9-b8dc-17ae0a569230 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:32.821719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0c2f9-41ca-44c9-b8dc-17ae0a569230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:32.841715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8bd0c2f9-41ca-44c9-b8dc-17ae0a569230 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:32.843909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8bd0c2f9-41ca-44c9-b8dc-17ae0a569230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:32.851071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1170/2344] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:32.877304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b44da7-7b24-4fee-9dfe-f7e303caf940 service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:32.890728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b44da7-7b24-4fee-9dfe-f7e303caf940 service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:32.896680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf10c-4832-40ee-8add-ad1944a66f4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:32.897325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf10c-4832-40ee-8add-ad1944a66f4e service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:32.897607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf10c-4832-40ee-8add-ad1944a66f4e service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:32.897987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf10c-4832-40ee-8add-ad1944a66f4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:32.907522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bf10c-4832-40ee-8add-ad1944a66f4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:32.909176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bf10c-4832-40ee-8add-ad1944a66f4e service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:32.919352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1175/2345] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:02:34.775047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0c2f9-41ca-44c9-b8dc-17ae0a569230 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:34.777443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8bd0c2f9-41ca-44c9-b8dc-17ae0a569230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:34.792203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0c2f9-41ca-44c9-b8dc-17ae0a569230 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:34.797362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:34.798012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:34.798290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:34.798574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] PATH_INFO: `/v3/users/37b45e6d825947ce87d70277522964a2` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:34.799801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b45e6d825947ce87d70277522964a2)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:34.808420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:35.035956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b45e6d825947ce87d70277522964a2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.036613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b45e6d825947ce87d70277522964a2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.141998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b45e6d825947ce87d70277522964a2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.151607 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b45e6d825947ce87d70277522964a2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.165329 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:35.170193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6c4be89-8a89-4a99-99ca-389f36840f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b45e6d825947ce87d70277522964a2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.176171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1171/2346] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:02:34 2022] DELETE /identity/v3/users/37b45e6d825947ce87d70277522964a2 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:02:35.427551 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf10c-4832-40ee-8add-ad1944a66f4e service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:35.437865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf10c-4832-40ee-8add-ad1944a66f4e service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:35.509833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:35.510475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:35.510759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:35.511011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] PATH_INFO: `/v3/projects/460fe89606fd484791e3e683aa6c9068` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:35.512213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=460fe89606fd484791e3e683aa6c9068)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:35.514157 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:35.665589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460fe89606fd484791e3e683aa6c9068', 'request_id': 'req-4786126f-6d16-4d54-979e-e387f821c9ab'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.671688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460fe89606fd484791e3e683aa6c9068', 'request_id': 'req-4786126f-6d16-4d54-979e-e387f821c9ab'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.678290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460fe89606fd484791e3e683aa6c9068', 'request_id': 'req-4786126f-6d16-4d54-979e-e387f821c9ab'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.776998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] The token cache is being invalidate because project 460fe89606fd484791e3e683aa6c9068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:02:35.777358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.778037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4786126f-6d16-4d54-979e-e387f821c9ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:02:35.779816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1176/2347] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:02:35 2022] DELETE /identity/v3/projects/460fe89606fd484791e3e683aa6c9068 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:02:35.784802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da5335-b38e-4b06-aecc-5cbad0d33d17 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:35.785355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da5335-b38e-4b06-aecc-5cbad0d33d17 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:35.785355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da5335-b38e-4b06-aecc-5cbad0d33d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:35.812287 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b7da5335-b38e-4b06-aecc-5cbad0d33d17 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:35.813520 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b7da5335-b38e-4b06-aecc-5cbad0d33d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:35.878955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1172/2348] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:02:35.887814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c3c47-e12a-46cb-a3ae-8dc36df8bdf6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:35.888097 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c3c47-e12a-46cb-a3ae-8dc36df8bdf6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:35.888372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c3c47-e12a-46cb-a3ae-8dc36df8bdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:35.909825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4e2c3c47-e12a-46cb-a3ae-8dc36df8bdf6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:35.911414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4e2c3c47-e12a-46cb-a3ae-8dc36df8bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:35.921023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1177/2349] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:02:35.925194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da5335-b38e-4b06-aecc-5cbad0d33d17 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:35.935392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da5335-b38e-4b06-aecc-5cbad0d33d17 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:35.941558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a80e6b-2103-4566-b454-1774623ba6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:35.942192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a80e6b-2103-4566-b454-1774623ba6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:35.942468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a80e6b-2103-4566-b454-1774623ba6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:35.942743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a80e6b-2103-4566-b454-1774623ba6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:35.943542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a80e6b-2103-4566-b454-1774623ba6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:02:35.944338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a80e6b-2103-4566-b454-1774623ba6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:35.946370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a80e6b-2103-4566-b454-1774623ba6b4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:35.962116 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1173/2350] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:02:35.965699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c3c47-e12a-46cb-a3ae-8dc36df8bdf6 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:35.977554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c3c47-e12a-46cb-a3ae-8dc36df8bdf6 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:35.984647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e80e9-a09c-4c19-86d5-a3c4d6ee70ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:35.985581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e80e9-a09c-4c19-86d5-a3c4d6ee70ee admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:35.985967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e80e9-a09c-4c19-86d5-a3c4d6ee70ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:35.986248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e80e9-a09c-4c19-86d5-a3c4d6ee70ee admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:35.986939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e80e9-a09c-4c19-86d5-a3c4d6ee70ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:35.989067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e80e9-a09c-4c19-86d5-a3c4d6ee70ee admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:36.076496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1178/2351] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:02:35 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:02:36.080703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a80e6b-2103-4566-b454-1774623ba6b4 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:36.093227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a80e6b-2103-4566-b454-1774623ba6b4 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:36.162290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dcb8d-3b4f-46bb-8816-9644c9524463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:36.162967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcb8d-3b4f-46bb-8816-9644c9524463 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:36.163528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcb8d-3b4f-46bb-8816-9644c9524463 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:36.163863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dcb8d-3b4f-46bb-8816-9644c9524463 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:36.164511 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dcb8d-3b4f-46bb-8816-9644c9524463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:36.166490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dcb8d-3b4f-46bb-8816-9644c9524463 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:36.245541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1174/2352] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:02:36 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:02:36.249852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e80e9-a09c-4c19-86d5-a3c4d6ee70ee admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:36.261296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e80e9-a09c-4c19-86d5-a3c4d6ee70ee admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:36.266153 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabead4-20d7-4e9e-899e-b1d6eef6bb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:36.266759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabead4-20d7-4e9e-899e-b1d6eef6bb65 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:36.267040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabead4-20d7-4e9e-899e-b1d6eef6bb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:36.267348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabead4-20d7-4e9e-899e-b1d6eef6bb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:36.267998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabead4-20d7-4e9e-899e-b1d6eef6bb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:36.269652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabead4-20d7-4e9e-899e-b1d6eef6bb65 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:36.283730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1179/2353] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:02:36.287907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dcb8d-3b4f-46bb-8816-9644c9524463 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:36.298558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dcb8d-3b4f-46bb-8816-9644c9524463 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:36.303997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee61a-b374-493d-8839-e3bb329b74d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:36.304921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee61a-b374-493d-8839-e3bb329b74d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:36.305202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee61a-b374-493d-8839-e3bb329b74d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:36.305476 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee61a-b374-493d-8839-e3bb329b74d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:36.306134 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee61a-b374-493d-8839-e3bb329b74d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:36.307795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee61a-b374-493d-8839-e3bb329b74d4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:36.319622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1175/2354] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:02:36.324204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabead4-20d7-4e9e-899e-b1d6eef6bb65 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:36.329803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:36.335716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabead4-20d7-4e9e-899e-b1d6eef6bb65 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:36.340854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c401-af32-46d0-9efa-2a39a511eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:36.341531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c401-af32-46d0-9efa-2a39a511eeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:36.341811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c401-af32-46d0-9efa-2a39a511eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:36.342087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830c401-af32-46d0-9efa-2a39a511eeaa admin admin] PATH_INFO: `/v3/projects/095b6f14ca054b848d8f1164519af641/users/76086be41497482d9dc8eb770c272506/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:36.359725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830c401-af32-46d0-9efa-2a39a511eeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=095b6f14ca054b848d8f1164519af641, user_id=76086be41497482d9dc8eb770c272506, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:36.362426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830c401-af32-46d0-9efa-2a39a511eeaa admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:36.448658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1180/2355] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:02:36 2022] PUT /identity/v3/projects/095b6f14ca054b848d8f1164519af641/users/76086be41497482d9dc8eb770c272506/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:02:36.453604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea40103-1cf0-4a05-9284-3d3ca402c86b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:36.463546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea40103-1cf0-4a05-9284-3d3ca402c86b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:36.463546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea40103-1cf0-4a05-9284-3d3ca402c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:36.474373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-aea40103-1cf0-4a05-9284-3d3ca402c86b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:36.475681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-aea40103-1cf0-4a05-9284-3d3ca402c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:36.536931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:36.546723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1176/2356] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:36.557014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c401-af32-46d0-9efa-2a39a511eeaa admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:36.558975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c830c401-af32-46d0-9efa-2a39a511eeaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:36.623154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830c401-af32-46d0-9efa-2a39a511eeaa admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:36.627431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a5652-54ed-4a4c-9e91-2e328214feea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:36.630259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5652-54ed-4a4c-9e91-2e328214feea service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:36.630259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5652-54ed-4a4c-9e91-2e328214feea service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:36.630259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5652-54ed-4a4c-9e91-2e328214feea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:36.640707 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a5652-54ed-4a4c-9e91-2e328214feea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:36.642236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a5652-54ed-4a4c-9e91-2e328214feea service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:36.654249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1181/2357] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:02:37.098918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2203f2f-0791-46cc-bad7-568c27d1ad69 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:37.099500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2203f2f-0791-46cc-bad7-568c27d1ad69 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:37.099623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2203f2f-0791-46cc-bad7-568c27d1ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:37.121142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b2203f2f-0791-46cc-bad7-568c27d1ad69 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:37.122392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b2203f2f-0791-46cc-bad7-568c27d1ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:37.193616 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1177/2358] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 20:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:37.202439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a5652-54ed-4a4c-9e91-2e328214feea service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:37.204009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a38a5652-54ed-4a4c-9e91-2e328214feea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:37.346583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a5652-54ed-4a4c-9e91-2e328214feea service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:37.353153 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4c78f-f069-4503-b88a-642489b572d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:37.353876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4c78f-f069-4503-b88a-642489b572d4 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:37.354801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4c78f-f069-4503-b88a-642489b572d4 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:37.354801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4c78f-f069-4503-b88a-642489b572d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:37.368633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4c78f-f069-4503-b88a-642489b572d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:37.370313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4c78f-f069-4503-b88a-642489b572d4 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:37.380066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1182/2359] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:02:38.221943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578d68-05f8-43bc-a6e3-a83b3741cd55 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:38.222445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578d68-05f8-43bc-a6e3-a83b3741cd55 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:38.222529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578d68-05f8-43bc-a6e3-a83b3741cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:38.264787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8f578d68-05f8-43bc-a6e3-a83b3741cd55 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:38.266064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8f578d68-05f8-43bc-a6e3-a83b3741cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:38.296555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1178/2360] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:38.314852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4c78f-f069-4503-b88a-642489b572d4 service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:38.316720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-04b4c78f-f069-4503-b88a-642489b572d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:38.487453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4c78f-f069-4503-b88a-642489b572d4 service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:38.512430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c96fc-aaf3-49cc-91bd-6d3202677aa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:38.514198 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c96fc-aaf3-49cc-91bd-6d3202677aa7 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:38.515862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c96fc-aaf3-49cc-91bd-6d3202677aa7 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:38.516512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c96fc-aaf3-49cc-91bd-6d3202677aa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:38.533456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:38.543351 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c96fc-aaf3-49cc-91bd-6d3202677aa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:38.547962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c96fc-aaf3-49cc-91bd-6d3202677aa7 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:38.588958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1183/2361] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:02:42.700024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a28b3-1187-4faa-910a-9e4ce7c47dec None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:42.700637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a28b3-1187-4faa-910a-9e4ce7c47dec None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:42.700637 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a28b3-1187-4faa-910a-9e4ce7c47dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:42.797988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ad6a28b3-1187-4faa-910a-9e4ce7c47dec None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:42.804982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ad6a28b3-1187-4faa-910a-9e4ce7c47dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:42.823541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1179/2362] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:42.840105 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c96fc-aaf3-49cc-91bd-6d3202677aa7 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:42.860193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c96fc-aaf3-49cc-91bd-6d3202677aa7 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:42.880005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc469c-cf0f-442f-8a5a-b6010b404fca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:42.880926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc469c-cf0f-442f-8a5a-b6010b404fca service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:42.884762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc469c-cf0f-442f-8a5a-b6010b404fca service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:42.885261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc469c-cf0f-442f-8a5a-b6010b404fca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:42.901956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc469c-cf0f-442f-8a5a-b6010b404fca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:42.904081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc469c-cf0f-442f-8a5a-b6010b404fca service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:42.926782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1184/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:02:44.233909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff2655-b820-4f6e-9cfd-d29a217b4b7f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:44.234730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff2655-b820-4f6e-9cfd-d29a217b4b7f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:44.234730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff2655-b820-4f6e-9cfd-d29a217b4b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:44.289265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-9aff2655-b820-4f6e-9cfd-d29a217b4b7f None None] MFA Rules not processed for user `76086be41497482d9dc8eb770c272506`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:44.293829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9aff2655-b820-4f6e-9cfd-d29a217b4b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:44.443549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1180/2364] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:02:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:44.449516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc469c-cf0f-442f-8a5a-b6010b404fca service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:44.468723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc469c-cf0f-442f-8a5a-b6010b404fca service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:44.488178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d53775-e08f-4a99-8419-0870a9c45c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:44.488976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53775-e08f-4a99-8419-0870a9c45c78 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:44.489610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53775-e08f-4a99-8419-0870a9c45c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:44.489985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d53775-e08f-4a99-8419-0870a9c45c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:44.490802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d53775-e08f-4a99-8419-0870a9c45c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:44.493261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d53775-e08f-4a99-8419-0870a9c45c78 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:44.602803 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1185/2365] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:02:44 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:02:44.606984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff2655-b820-4f6e-9cfd-d29a217b4b7f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:44.624998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff2655-b820-4f6e-9cfd-d29a217b4b7f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:44.706771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39973745-ea2d-44b6-86fa-2c8012e6b3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:44.707450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39973745-ea2d-44b6-86fa-2c8012e6b3bd admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:44.707734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39973745-ea2d-44b6-86fa-2c8012e6b3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:44.708012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39973745-ea2d-44b6-86fa-2c8012e6b3bd admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:44.708672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39973745-ea2d-44b6-86fa-2c8012e6b3bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:44.711380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39973745-ea2d-44b6-86fa-2c8012e6b3bd admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:44.797072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1181/2366] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:02:44 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:02:44.804954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d53775-e08f-4a99-8419-0870a9c45c78 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:44.842405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d53775-e08f-4a99-8419-0870a9c45c78 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:44.880807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb4b9e-26dc-4af8-91d1-4630c99e83e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:44.882445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb4b9e-26dc-4af8-91d1-4630c99e83e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:44.884122 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb4b9e-26dc-4af8-91d1-4630c99e83e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:44.884617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb4b9e-26dc-4af8-91d1-4630c99e83e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:44.885494 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb4b9e-26dc-4af8-91d1-4630c99e83e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:44.894039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb4b9e-26dc-4af8-91d1-4630c99e83e1 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:44.911859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1186/2367] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:02:44.917868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39973745-ea2d-44b6-86fa-2c8012e6b3bd admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:44.931273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39973745-ea2d-44b6-86fa-2c8012e6b3bd admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:44.936251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcae221-3bfd-47ab-bb6d-405fcd9bf381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:44.936996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcae221-3bfd-47ab-bb6d-405fcd9bf381 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:44.937282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcae221-3bfd-47ab-bb6d-405fcd9bf381 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:44.937559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcae221-3bfd-47ab-bb6d-405fcd9bf381 admin admin] PATH_INFO: `/v3/projects/f3b54b0fedcb48eb80c2eed690540e7c/users/5a2f702bc4c6443299581ced6f925c07/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:44.941870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:44.956933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcae221-3bfd-47ab-bb6d-405fcd9bf381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b54b0fedcb48eb80c2eed690540e7c, user_id=5a2f702bc4c6443299581ced6f925c07, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:44.960176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcae221-3bfd-47ab-bb6d-405fcd9bf381 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:45.092175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1182/2368] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:02:44 2022] PUT /identity/v3/projects/f3b54b0fedcb48eb80c2eed690540e7c/users/5a2f702bc4c6443299581ced6f925c07/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:02:45.107304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb4b9e-26dc-4af8-91d1-4630c99e83e1 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:45.119911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb4b9e-26dc-4af8-91d1-4630c99e83e1 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:45.237763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae2c1-d6e2-49c2-a2cb-e2db72a70941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:45.238649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae2c1-d6e2-49c2-a2cb-e2db72a70941 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:45.239138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae2c1-d6e2-49c2-a2cb-e2db72a70941 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:45.239639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae2c1-d6e2-49c2-a2cb-e2db72a70941 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:45.240512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fae2c1-d6e2-49c2-a2cb-e2db72a70941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:45.245556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fae2c1-d6e2-49c2-a2cb-e2db72a70941 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:45.278532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1187/2369] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:02:45.280123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcae221-3bfd-47ab-bb6d-405fcd9bf381 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:45.293837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcae221-3bfd-47ab-bb6d-405fcd9bf381 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:45.305653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7105906-283d-4ad2-a0cb-e1876ba7d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:45.306584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7105906-283d-4ad2-a0cb-e1876ba7d305 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:45.307051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7105906-283d-4ad2-a0cb-e1876ba7d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:45.310734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7105906-283d-4ad2-a0cb-e1876ba7d305 admin admin] PATH_INFO: `/v3/projects/f3b54b0fedcb48eb80c2eed690540e7c/users/5a2f702bc4c6443299581ced6f925c07/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:45.317123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7105906-283d-4ad2-a0cb-e1876ba7d305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b54b0fedcb48eb80c2eed690540e7c, user_id=5a2f702bc4c6443299581ced6f925c07, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:45.324638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7105906-283d-4ad2-a0cb-e1876ba7d305 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:45.344515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1183/2370] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:02:45 2022] PUT /identity/v3/projects/f3b54b0fedcb48eb80c2eed690540e7c/users/5a2f702bc4c6443299581ced6f925c07/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:02:54.046799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baadab4-4a57-45ef-b7f1-4a15d0d755bd None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:54.047397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baadab4-4a57-45ef-b7f1-4a15d0d755bd None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:54.047496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baadab4-4a57-45ef-b7f1-4a15d0d755bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:54.080676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-5baadab4-4a57-45ef-b7f1-4a15d0d755bd None None] MFA Rules not processed for user `5a2f702bc4c6443299581ced6f925c07`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:54.082636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5baadab4-4a57-45ef-b7f1-4a15d0d755bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:54.176630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1188/2371] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:02:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:54.190586 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7105906-283d-4ad2-a0cb-e1876ba7d305 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:54.192722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e7105906-283d-4ad2-a0cb-e1876ba7d305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:54.259780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7105906-283d-4ad2-a0cb-e1876ba7d305 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:54.264604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4edbab-07b2-46d7-b1f9-0c68fe13ffda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4414630bb2da4523906f0b2dee0c4c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:54.265297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4edbab-07b2-46d7-b1f9-0c68fe13ffda service glance] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:54.265640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4edbab-07b2-46d7-b1f9-0c68fe13ffda service glance] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:54.265975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4edbab-07b2-46d7-b1f9-0c68fe13ffda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:54.334099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4edbab-07b2-46d7-b1f9-0c68fe13ffda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:54.336034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4edbab-07b2-46d7-b1f9-0c68fe13ffda service glance] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:54.345887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1184/2372] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:02:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:02:54.674379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8de73-ec7a-4f51-a5c8-d25289a33d50 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:54.674663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8de73-ec7a-4f51-a5c8-d25289a33d50 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:54.674941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8de73-ec7a-4f51-a5c8-d25289a33d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:54.696506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-efc8de73-ec7a-4f51-a5c8-d25289a33d50 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:02:54.697667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-efc8de73-ec7a-4f51-a5c8-d25289a33d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:02:54.726201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:02:54.760086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1189/2373] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 20:02:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:02:54.774331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4edbab-07b2-46d7-b1f9-0c68fe13ffda service glance] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:02:54.844400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4edbab-07b2-46d7-b1f9-0c68fe13ffda service glance] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:02:54.849551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8bfee-ec1e-4213-8ae6-82d57ef373d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:02:54.850751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8bfee-ec1e-4213-8ae6-82d57ef373d4 service swift] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:02:54.851033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8bfee-ec1e-4213-8ae6-82d57ef373d4 service swift] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:02:54.851491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8bfee-ec1e-4213-8ae6-82d57ef373d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:02:54.860736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8bfee-ec1e-4213-8ae6-82d57ef373d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:02:54.862386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8bfee-ec1e-4213-8ae6-82d57ef373d4 service swift] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:02:54.871124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1185/2374] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:02:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:03:02.890883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc759c9f-1926-4ba2-9fcb-e949613fc317 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:02.891895 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc759c9f-1926-4ba2-9fcb-e949613fc317 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:02.892359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc759c9f-1926-4ba2-9fcb-e949613fc317 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:02.894117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1190/2375] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 20:03:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:03:02.901447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8b638-14b6-4872-999a-0d03becbf312 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:02.902412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8b638-14b6-4872-999a-0d03becbf312 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:02.902870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8b638-14b6-4872-999a-0d03becbf312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:02.933552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3ea8b638-14b6-4872-999a-0d03becbf312 None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:03:02.935123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3ea8b638-14b6-4872-999a-0d03becbf312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:03:02.948238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:03.049398 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1186/2376] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 20:03:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:03:03.061285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc759c9f-1926-4ba2-9fcb-e949613fc317 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:03:03.073251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc759c9f-1926-4ba2-9fcb-e949613fc317 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:03:03.077355 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2baa4b-7db6-475a-9ce0-9ec6cc0cead5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4414630bb2da4523906f0b2dee0c4c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:03:03.078257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2baa4b-7db6-475a-9ce0-9ec6cc0cead5 service glance] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:03.078693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2baa4b-7db6-475a-9ce0-9ec6cc0cead5 service glance] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:03.078968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2baa4b-7db6-475a-9ce0-9ec6cc0cead5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:03.090573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2baa4b-7db6-475a-9ce0-9ec6cc0cead5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:03:03.092655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2baa4b-7db6-475a-9ce0-9ec6cc0cead5 service glance] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:03:03.105715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1191/2377] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:03:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:03:03.341300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c69e8-82b9-4cae-bc74-e92e33dd384c None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:03.341488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c69e8-82b9-4cae-bc74-e92e33dd384c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:03.342732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c69e8-82b9-4cae-bc74-e92e33dd384c None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:03.343400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1187/2378] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 20:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:03:03.348800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b9343-9731-4d27-acfd-3a8f600f4829 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:03.349205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b9343-9731-4d27-acfd-3a8f600f4829 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:03.349583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b9343-9731-4d27-acfd-3a8f600f4829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:03.375401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6b8b9343-9731-4d27-acfd-3a8f600f4829 None None] MFA Rules not processed for user `7500529eff574ca6ae3a9a77d72d2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:03:03.376621 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6b8b9343-9731-4d27-acfd-3a8f600f4829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:03:03.456223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1192/2379] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 20:03:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:03:03.469776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c69e8-82b9-4cae-bc74-e92e33dd384c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:03:03.472051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-611c69e8-82b9-4cae-bc74-e92e33dd384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:03:03.499476 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c69e8-82b9-4cae-bc74-e92e33dd384c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:03:03.505555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644e05e-f971-471c-8f12-9268d3cbf215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:03:03.506514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644e05e-f971-471c-8f12-9268d3cbf215 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:03.506944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644e05e-f971-471c-8f12-9268d3cbf215 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:03.507198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644e05e-f971-471c-8f12-9268d3cbf215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:03.518834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644e05e-f971-471c-8f12-9268d3cbf215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:03:03.520428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644e05e-f971-471c-8f12-9268d3cbf215 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:03:03.531386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1188/2380] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:03:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:03:03.652627 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4bee5-e7f1-4190-8546-52f3f33fb414 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:03.652912 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4bee5-e7f1-4190-8546-52f3f33fb414 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:03.653178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4bee5-e7f1-4190-8546-52f3f33fb414 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:03.654713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1193/2381] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 20:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:03:03.660834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2bf4a-dfb1-497b-9106-2ba4673a850e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:03.661113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2bf4a-dfb1-497b-9106-2ba4673a850e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:03.661396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2bf4a-dfb1-497b-9106-2ba4673a850e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:03.690791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-54f2bf4a-dfb1-497b-9106-2ba4673a850e None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:03:03.692320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-54f2bf4a-dfb1-497b-9106-2ba4673a850e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:03:03.705121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1189/2382] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 20:03:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:03:03.718782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4bee5-e7f1-4190-8546-52f3f33fb414 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:03:03.734689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4bee5-e7f1-4190-8546-52f3f33fb414 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:03:03.740249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3c4d9-7aed-45f4-b474-4ea86714b984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:03:03.740887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3c4d9-7aed-45f4-b474-4ea86714b984 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:03.741169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3c4d9-7aed-45f4-b474-4ea86714b984 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:03.741708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3c4d9-7aed-45f4-b474-4ea86714b984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:03.755123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3c4d9-7aed-45f4-b474-4ea86714b984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:03:03.756616 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3c4d9-7aed-45f4-b474-4ea86714b984 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:03:03.772144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1194/2383] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:03:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:03:06.701947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fee7e-fd53-4d29-bf75-463c430b298b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:06.702589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fee7e-fd53-4d29-bf75-463c430b298b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:06.702589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fee7e-fd53-4d29-bf75-463c430b298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:06.722886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ff0fee7e-fd53-4d29-bf75-463c430b298b None None] MFA Rules not processed for user `fcf69e962d7842acb6f9b9433169ada1`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:03:06.724314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ff0fee7e-fd53-4d29-bf75-463c430b298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:03:06.804098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1190/2384] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:03:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:03:07.123004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8bb48-fe3c-432e-9771-842bbae78cd4 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:07.123608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8bb48-fe3c-432e-9771-842bbae78cd4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:07.123608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8bb48-fe3c-432e-9771-842bbae78cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:07.144847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-d6d8bb48-fe3c-432e-9771-842bbae78cd4 None None] MFA Rules not processed for user `76086be41497482d9dc8eb770c272506`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:03:07.147011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d6d8bb48-fe3c-432e-9771-842bbae78cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:03:07.158964 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1195/2385] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:03:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:03:09.110902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19418ce-74a6-4901-b0cb-4268c7b60e91 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:09.111447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19418ce-74a6-4901-b0cb-4268c7b60e91 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:09.111530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19418ce-74a6-4901-b0cb-4268c7b60e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:09.136489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c19418ce-74a6-4901-b0cb-4268c7b60e91 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:03:09.138173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c19418ce-74a6-4901-b0cb-4268c7b60e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:03:09.145815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1191/2386] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 20:03:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:03:09.160637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8bb48-fe3c-432e-9771-842bbae78cd4 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:03:09.175196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8bb48-fe3c-432e-9771-842bbae78cd4 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:03:09.189111 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2d189-65bc-4d77-aaad-b4f5aa7c3698 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:03:09.190008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2d189-65bc-4d77-aaad-b4f5aa7c3698 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:09.190288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2d189-65bc-4d77-aaad-b4f5aa7c3698 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:09.191476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2d189-65bc-4d77-aaad-b4f5aa7c3698 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:09.204479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2d189-65bc-4d77-aaad-b4f5aa7c3698 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:03:09.207260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2d189-65bc-4d77-aaad-b4f5aa7c3698 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:03:09.220831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1196/2387] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:03:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:03:19.130010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=61 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:19.217239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=55 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:29.330463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a7cc6-fa8a-4603-96e3-7db4835d1043 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:29.330463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a7cc6-fa8a-4603-96e3-7db4835d1043 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:29.330463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a7cc6-fa8a-4603-96e3-7db4835d1043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:29.358222 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-901a7cc6-fa8a-4603-96e3-7db4835d1043 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:03:29.360371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-901a7cc6-fa8a-4603-96e3-7db4835d1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:03:29.367629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1192/2388] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 20:03:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:03:29.390371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2d189-65bc-4d77-aaad-b4f5aa7c3698 service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:03:29.404043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2d189-65bc-4d77-aaad-b4f5aa7c3698 service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:03:29.410670 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb20451-708d-4f20-b3f9-8ad8210391f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:03:29.411251 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb20451-708d-4f20-b3f9-8ad8210391f8 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:29.411735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb20451-708d-4f20-b3f9-8ad8210391f8 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:29.412008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb20451-708d-4f20-b3f9-8ad8210391f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:29.424115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb20451-708d-4f20-b3f9-8ad8210391f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:03:29.425958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb20451-708d-4f20-b3f9-8ad8210391f8 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:03:29.442108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1197/2389] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:03:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:03:39.351471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:39.432953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=6 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:46.814341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000df17-6229-4b87-a575-61a1e3b77161 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:46.814927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000df17-6229-4b87-a575-61a1e3b77161 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:46.814927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000df17-6229-4b87-a575-61a1e3b77161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:46.835373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-5000df17-6229-4b87-a575-61a1e3b77161 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:03:46.836595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5000df17-6229-4b87-a575-61a1e3b77161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:03:46.844488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1193/2390] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:03:46.857917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb20451-708d-4f20-b3f9-8ad8210391f8 service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:03:46.870570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb20451-708d-4f20-b3f9-8ad8210391f8 service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:03:46.876577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fc04c-f91e-4a19-a0a3-f41f4189989d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:03:46.877193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc04c-f91e-4a19-a0a3-f41f4189989d service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:03:46.877492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc04c-f91e-4a19-a0a3-f41f4189989d service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:03:46.877761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fc04c-f91e-4a19-a0a3-f41f4189989d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:03:46.888985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fc04c-f91e-4a19-a0a3-f41f4189989d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:03:46.890643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fc04c-f91e-4a19-a0a3-f41f4189989d service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:03:46.901213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1198/2391] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:03:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:03:56.831808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:03:56.900974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=6 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:00.043936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35321e-5fa7-46b5-a062-6157e15b8dc6 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:00.044549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35321e-5fa7-46b5-a062-6157e15b8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:00.044549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35321e-5fa7-46b5-a062-6157e15b8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:00.065004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-5e35321e-5fa7-46b5-a062-6157e15b8dc6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:04:00.067001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5e35321e-5fa7-46b5-a062-6157e15b8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:00.134045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1194/2392] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:04:00.149460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fc04c-f91e-4a19-a0a3-f41f4189989d service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:00.151502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4a2fc04c-f91e-4a19-a0a3-f41f4189989d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:00.166949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fc04c-f91e-4a19-a0a3-f41f4189989d service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:00.173268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559d3c3-33e7-4f83-b1a7-496de2e0db4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:00.173923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d3c3-33e7-4f83-b1a7-496de2e0db4d service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:00.174205 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d3c3-33e7-4f83-b1a7-496de2e0db4d service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:00.175086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d3c3-33e7-4f83-b1a7-496de2e0db4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:00.184324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559d3c3-33e7-4f83-b1a7-496de2e0db4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:00.185959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559d3c3-33e7-4f83-b1a7-496de2e0db4d service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:00.196274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1199/2393] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:04.034159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35321e-5fa7-46b5-a062-6157e15b8dc6 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:04.044465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35321e-5fa7-46b5-a062-6157e15b8dc6 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:04.048028 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688343db-3bfc-4b7f-b1f1-a8a7e544aba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:04.048631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688343db-3bfc-4b7f-b1f1-a8a7e544aba3 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:04.048907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688343db-3bfc-4b7f-b1f1-a8a7e544aba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:04.049179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688343db-3bfc-4b7f-b1f1-a8a7e544aba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:04.050918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-688343db-3bfc-4b7f-b1f1-a8a7e544aba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:04.064916 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688343db-3bfc-4b7f-b1f1-a8a7e544aba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:04.066344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688343db-3bfc-4b7f-b1f1-a8a7e544aba3 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:04.077921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1195/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:05.601126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf91d1d-cf84-4b0d-aad1-aeb4636ab9c6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:05.601669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf91d1d-cf84-4b0d-aad1-aeb4636ab9c6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:05.601669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf91d1d-cf84-4b0d-aad1-aeb4636ab9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:05.621396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ebf91d1d-cf84-4b0d-aad1-aeb4636ab9c6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:04:05.622622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ebf91d1d-cf84-4b0d-aad1-aeb4636ab9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:05.631245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1200/2395] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:04:05.651957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688343db-3bfc-4b7f-b1f1-a8a7e544aba3 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:05.666395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688343db-3bfc-4b7f-b1f1-a8a7e544aba3 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:05.675837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80d94-b25a-4b4e-ab45-f74f6bd89340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:05.677581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80d94-b25a-4b4e-ab45-f74f6bd89340 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:05.677581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80d94-b25a-4b4e-ab45-f74f6bd89340 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:05.677581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80d94-b25a-4b4e-ab45-f74f6bd89340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:05.687182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a80d94-b25a-4b4e-ab45-f74f6bd89340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:05.689182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a80d94-b25a-4b4e-ab45-f74f6bd89340 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:05.700952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1196/2396] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:06.547211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf91d1d-cf84-4b0d-aad1-aeb4636ab9c6 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:06.557469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf91d1d-cf84-4b0d-aad1-aeb4636ab9c6 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:06.561150 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38eac8c-3d42-442c-a958-f3ebc1c577f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:06.561768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eac8c-3d42-442c-a958-f3ebc1c577f8 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:06.562046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eac8c-3d42-442c-a958-f3ebc1c577f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:06.562318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38eac8c-3d42-442c-a958-f3ebc1c577f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:06.564307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e38eac8c-3d42-442c-a958-f3ebc1c577f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:06.579379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38eac8c-3d42-442c-a958-f3ebc1c577f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:06.581053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38eac8c-3d42-442c-a958-f3ebc1c577f8 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:06.594873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1201/2397] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:09.966213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80d94-b25a-4b4e-ab45-f74f6bd89340 service nova] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:09.976536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80d94-b25a-4b4e-ab45-f74f6bd89340 service nova] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:09.980210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256549c8-0af3-4948-bacd-5dffd5350fa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:09.980839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256549c8-0af3-4948-bacd-5dffd5350fa7 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:09.981119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256549c8-0af3-4948-bacd-5dffd5350fa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:09.981499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256549c8-0af3-4948-bacd-5dffd5350fa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:09.992440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256549c8-0af3-4948-bacd-5dffd5350fa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:09.994049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256549c8-0af3-4948-bacd-5dffd5350fa7 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:10.004602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1197/2398] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:10.509802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0ecb6-22f1-424a-b005-cb154209bbd2 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:10.510775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0ecb6-22f1-424a-b005-cb154209bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:10.511390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0ecb6-22f1-424a-b005-cb154209bbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:10.542280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-04d0ecb6-22f1-424a-b005-cb154209bbd2 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:04:10.543939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-04d0ecb6-22f1-424a-b005-cb154209bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:10.559507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1202/2399] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:04:10.630416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256549c8-0af3-4948-bacd-5dffd5350fa7 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:10.643244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256549c8-0af3-4948-bacd-5dffd5350fa7 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:10.652785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5b33-f4f1-4139-90f4-f486c79c3c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:10.653521 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5b33-f4f1-4139-90f4-f486c79c3c0c service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:10.653798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5b33-f4f1-4139-90f4-f486c79c3c0c service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:10.654248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5b33-f4f1-4139-90f4-f486c79c3c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:10.664772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5b33-f4f1-4139-90f4-f486c79c3c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:10.666436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5b33-f4f1-4139-90f4-f486c79c3c0c service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:10.683523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1198/2400] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:15.852883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bff88-799c-423f-9dc6-88c41e853f01 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:15.853651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bff88-799c-423f-9dc6-88c41e853f01 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:15.853651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bff88-799c-423f-9dc6-88c41e853f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:15.873597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-803bff88-799c-423f-9dc6-88c41e853f01 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:04:15.874835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-803bff88-799c-423f-9dc6-88c41e853f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:15.883699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1203/2401] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:04:16.017976 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5b33-f4f1-4139-90f4-f486c79c3c0c service nova] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:16.035458 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5b33-f4f1-4139-90f4-f486c79c3c0c service nova] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:16.042098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae80f8b-ca43-403b-af10-2398a2c2b949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:16.042715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae80f8b-ca43-403b-af10-2398a2c2b949 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:16.042995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae80f8b-ca43-403b-af10-2398a2c2b949 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:16.043291 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae80f8b-ca43-403b-af10-2398a2c2b949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:16.052939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae80f8b-ca43-403b-af10-2398a2c2b949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:16.054600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae80f8b-ca43-403b-af10-2398a2c2b949 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:16.064722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1199/2402] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:22.578628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bff88-799c-423f-9dc6-88c41e853f01 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:22.591276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bff88-799c-423f-9dc6-88c41e853f01 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:22.596798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949934f-ec1d-4be5-8c93-cab6ce131a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:22.597386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949934f-ec1d-4be5-8c93-cab6ce131a07 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:22.597660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949934f-ec1d-4be5-8c93-cab6ce131a07 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:22.597927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949934f-ec1d-4be5-8c93-cab6ce131a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:22.599772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f949934f-ec1d-4be5-8c93-cab6ce131a07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:22.660099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949934f-ec1d-4be5-8c93-cab6ce131a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:22.661698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949934f-ec1d-4be5-8c93-cab6ce131a07 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:22.671234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1204/2403] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:23.228691 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab535fc-74de-42af-88af-a6d8d88c7662 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:23.229203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab535fc-74de-42af-88af-a6d8d88c7662 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:23.229387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab535fc-74de-42af-88af-a6d8d88c7662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:23.249712 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-fab535fc-74de-42af-88af-a6d8d88c7662 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:04:23.250938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fab535fc-74de-42af-88af-a6d8d88c7662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:23.259625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1200/2404] 10.222.0.59 () {58 vars in 1016 bytes} [Mon Aug 22 20:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:04:23.298913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949934f-ec1d-4be5-8c93-cab6ce131a07 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:23.310775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949934f-ec1d-4be5-8c93-cab6ce131a07 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:23.316255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ab907-b16f-48d5-b22c-1ea826d03f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:23.316879 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab907-b16f-48d5-b22c-1ea826d03f6d service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:23.317154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab907-b16f-48d5-b22c-1ea826d03f6d service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:23.317423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ab907-b16f-48d5-b22c-1ea826d03f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:23.326585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ab907-b16f-48d5-b22c-1ea826d03f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:23.328192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ab907-b16f-48d5-b22c-1ea826d03f6d service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:23.338305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1205/2405] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:24.745762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5552a7a-ccf4-47d2-a3a3-c57cdf87b4d4 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:24.746326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5552a7a-ccf4-47d2-a3a3-c57cdf87b4d4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:24.746326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5552a7a-ccf4-47d2-a3a3-c57cdf87b4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:24.766862 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-e5552a7a-ccf4-47d2-a3a3-c57cdf87b4d4 None None] MFA Rules not processed for user `49fc8627822f4765b08db422e7e580df`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:04:24.768256 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e5552a7a-ccf4-47d2-a3a3-c57cdf87b4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:24.833930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1201/2406] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:04:26.445949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ab907-b16f-48d5-b22c-1ea826d03f6d service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:26.457132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ab907-b16f-48d5-b22c-1ea826d03f6d service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:26.463404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd2c98-116d-4d3a-b553-3e295753f094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:26.464017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd2c98-116d-4d3a-b553-3e295753f094 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:26.464292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd2c98-116d-4d3a-b553-3e295753f094 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:26.464561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd2c98-116d-4d3a-b553-3e295753f094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:26.466614 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7ebd2c98-116d-4d3a-b553-3e295753f094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:26.478425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd2c98-116d-4d3a-b553-3e295753f094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:26.480124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd2c98-116d-4d3a-b553-3e295753f094 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:26.490112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1206/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:04:34.827066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=85 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:36.485698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=61 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:38.363544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8991-f7ef-4692-8580-e6ff7d7259ce None None] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:38.364017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8991-f7ef-4692-8580-e6ff7d7259ce None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:38.364145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8991-f7ef-4692-8580-e6ff7d7259ce None None] PATH_INFO: `/` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:38.365659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1202/2408] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 20:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:04:38.372221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76019a-b8a2-469d-bcff-c0fcdefe3b60 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:38.372670 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76019a-b8a2-469d-bcff-c0fcdefe3b60 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:38.372766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76019a-b8a2-469d-bcff-c0fcdefe3b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:38.394271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4f76019a-b8a2-469d-bcff-c0fcdefe3b60 None None] MFA Rules not processed for user `7500529eff574ca6ae3a9a77d72d2a40`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:04:38.394797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4f76019a-b8a2-469d-bcff-c0fcdefe3b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:38.401671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1207/2409] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:04:38.420552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8991-f7ef-4692-8580-e6ff7d7259ce None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:38.436286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8991-f7ef-4692-8580-e6ff7d7259ce None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:38.443585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1790e0-1940-472b-8aa0-5d0585b242b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:38.444282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1790e0-1940-472b-8aa0-5d0585b242b5 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:38.444569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1790e0-1940-472b-8aa0-5d0585b242b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:38.444859 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1790e0-1940-472b-8aa0-5d0585b242b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:38.453602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1790e0-1940-472b-8aa0-5d0585b242b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:38.455038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1790e0-1940-472b-8aa0-5d0585b242b5 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:38.463412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1203/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:38.551686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec98f5-2818-4313-8f1f-a273a531b927 None None] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:38.552017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec98f5-2818-4313-8f1f-a273a531b927 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:38.552550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec98f5-2818-4313-8f1f-a273a531b927 None None] PATH_INFO: `/` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:38.554649 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1208/2411] 10.222.0.18 () {54 vars in 921 bytes} [Mon Aug 22 20:04:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:04:38.561410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d84a6-8946-45bd-b7b8-211b2ad7967c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:38.572062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d84a6-8946-45bd-b7b8-211b2ad7967c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:38.572062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d84a6-8946-45bd-b7b8-211b2ad7967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:38.583277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d12d84a6-8946-45bd-b7b8-211b2ad7967c None None] MFA Rules not processed for user `1787fcb6f7c34de59c9682a4d8c3d2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:04:38.584603 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d12d84a6-8946-45bd-b7b8-211b2ad7967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:38.595057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1204/2412] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Aug 22 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:04:38.611091 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec98f5-2818-4313-8f1f-a273a531b927 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:38.630561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec98f5-2818-4313-8f1f-a273a531b927 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:38.636559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce010f-5a52-46b9-977e-0e68c1c7c6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:38.641405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce010f-5a52-46b9-977e-0e68c1c7c6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:38.641405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce010f-5a52-46b9-977e-0e68c1c7c6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:38.641405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce010f-5a52-46b9-977e-0e68c1c7c6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:38.650215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce010f-5a52-46b9-977e-0e68c1c7c6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:38.651732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce010f-5a52-46b9-977e-0e68c1c7c6c0 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:38.669952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1209/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:38.753370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d84a6-8946-45bd-b7b8-211b2ad7967c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:38.755464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d12d84a6-8946-45bd-b7b8-211b2ad7967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:38.870187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d84a6-8946-45bd-b7b8-211b2ad7967c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:38.877113 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16156f-5b52-4e6b-ae1e-b4177b039f75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:38.877737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16156f-5b52-4e6b-ae1e-b4177b039f75 service placement] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:38.878014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16156f-5b52-4e6b-ae1e-b4177b039f75 service placement] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:38.878286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16156f-5b52-4e6b-ae1e-b4177b039f75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:38.880324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7b16156f-5b52-4e6b-ae1e-b4177b039f75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:38.895099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16156f-5b52-4e6b-ae1e-b4177b039f75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:38.897433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16156f-5b52-4e6b-ae1e-b4177b039f75 service placement] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:38.911633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1205/2414] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:39.128663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce010f-5a52-46b9-977e-0e68c1c7c6c0 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:39.145667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce010f-5a52-46b9-977e-0e68c1c7c6c0 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:39.156386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf9523-f71f-4fb6-9807-349cef5345a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:39.161136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf9523-f71f-4fb6-9807-349cef5345a9 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:39.161136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf9523-f71f-4fb6-9807-349cef5345a9 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:39.161136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf9523-f71f-4fb6-9807-349cef5345a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:39.161136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-abdf9523-f71f-4fb6-9807-349cef5345a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:39.174555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf9523-f71f-4fb6-9807-349cef5345a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:39.176311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf9523-f71f-4fb6-9807-349cef5345a9 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:39.188384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1210/2415] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:40.532540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16156f-5b52-4e6b-ae1e-b4177b039f75 service placement] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:40.543913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16156f-5b52-4e6b-ae1e-b4177b039f75 service placement] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:40.547769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321e4c-250c-4acf-86e1-0c6ad0f589f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:40.548477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321e4c-250c-4acf-86e1-0c6ad0f589f8 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:40.548827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321e4c-250c-4acf-86e1-0c6ad0f589f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:40.549162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321e4c-250c-4acf-86e1-0c6ad0f589f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:40.551088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0e321e4c-250c-4acf-86e1-0c6ad0f589f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:40.562425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321e4c-250c-4acf-86e1-0c6ad0f589f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:40.569762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321e4c-250c-4acf-86e1-0c6ad0f589f8 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:40.583143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1206/2416] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:04:42.520069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf9523-f71f-4fb6-9807-349cef5345a9 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:42.532348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf9523-f71f-4fb6-9807-349cef5345a9 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:42.538210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:42.538847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:42.539124 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:42.539471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:42.541278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:42.554134 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:42.555704 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:42.566554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1211/2417] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:04:50.568823 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=47 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:52.562069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=21 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:04:58.524889 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321e4c-250c-4acf-86e1-0c6ad0f589f8 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:04:58.537964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321e4c-250c-4acf-86e1-0c6ad0f589f8 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:04:58.543566 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03255e1b-1d66-45e8-8992-65fadaf12c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:04:58.544160 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03255e1b-1d66-45e8-8992-65fadaf12c65 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:04:58.544446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03255e1b-1d66-45e8-8992-65fadaf12c65 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:04:58.544714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03255e1b-1d66-45e8-8992-65fadaf12c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:04:58.546430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-03255e1b-1d66-45e8-8992-65fadaf12c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:04:58.606512 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03255e1b-1d66-45e8-8992-65fadaf12c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:04:58.608732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03255e1b-1d66-45e8-8992-65fadaf12c65 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:04:58.619413 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1207/2418] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:04:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:05:03.722090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:05:03.725358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:05:03.743067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961260f3-831d-41c8-a34f-79b1b499b5da service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:05:03.753249 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:05:03.753931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:05:03.754213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:05:03.754486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] PATH_INFO: `/v3/users/fcf69e962d7842acb6f9b9433169ada1` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:05:03.755758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf69e962d7842acb6f9b9433169ada1)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:05:03.757714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:05:03.940894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf69e962d7842acb6f9b9433169ada1'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:03.941548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf69e962d7842acb6f9b9433169ada1'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:03.949343 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf69e962d7842acb6f9b9433169ada1'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:04.026742 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf69e962d7842acb6f9b9433169ada1'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:04.041681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2e1cc73b-2859-47f8-b537-29b928c5f49f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf69e962d7842acb6f9b9433169ada1'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:04.048049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1212/2419] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:05:03 2022] DELETE /identity/v3/users/fcf69e962d7842acb6f9b9433169ada1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:05:04.453957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03255e1b-1d66-45e8-8992-65fadaf12c65 service nova] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:05:04.466757 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03255e1b-1d66-45e8-8992-65fadaf12c65 service nova] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:05:04.558167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:05:04.558820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:05:04.559102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:05:04.559408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] PATH_INFO: `/v3/projects/f34b4acfa22a406d8b4c69687f5d66d4` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:05:04.560613 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34b4acfa22a406d8b4c69687f5d66d4)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:05:04.562564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:05:04.735890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34b4acfa22a406d8b4c69687f5d66d4', 'request_id': 'req-001e8fb7-557a-4d77-984f-e267cbcb78eb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:04.742475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34b4acfa22a406d8b4c69687f5d66d4', 'request_id': 'req-001e8fb7-557a-4d77-984f-e267cbcb78eb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:04.813703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34b4acfa22a406d8b4c69687f5d66d4', 'request_id': 'req-001e8fb7-557a-4d77-984f-e267cbcb78eb'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:04.828481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] The token cache is being invalidate because project f34b4acfa22a406d8b4c69687f5d66d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:05:04.828867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:04.829646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:05:04.831359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1208/2420] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:05:04 2022] DELETE /identity/v3/projects/f34b4acfa22a406d8b4c69687f5d66d4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:05:10.206167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053b214-d60d-4010-9346-37e5237e631f None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:05:10.206754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053b214-d60d-4010-9346-37e5237e631f None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:05:10.206754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053b214-d60d-4010-9346-37e5237e631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:05:10.228671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-5053b214-d60d-4010-9346-37e5237e631f None None] MFA Rules not processed for user `e6d3fd0d74c94f88aef2f0be0047ee9a`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:05:10.233878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5053b214-d60d-4010-9346-37e5237e631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:05:10.293798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1213/2421] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:05:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:05:10.671523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:05:10.673447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:05:10.718446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:10.749567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e8fb7-557a-4d77-984f-e267cbcb78eb admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:05:10.755999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e15a03-1eb2-4d67-8e9b-38b4cc34c945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:05:10.757719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e15a03-1eb2-4d67-8e9b-38b4cc34c945 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:05:10.758143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e15a03-1eb2-4d67-8e9b-38b4cc34c945 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:05:10.758562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e15a03-1eb2-4d67-8e9b-38b4cc34c945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:05:10.761615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-e8e15a03-1eb2-4d67-8e9b-38b4cc34c945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:05:10.774910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e15a03-1eb2-4d67-8e9b-38b4cc34c945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:05:10.777220 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e15a03-1eb2-4d67-8e9b-38b4cc34c945 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:05:10.787853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1209/2422] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:05:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:05:20.285650 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:20.853860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=13 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:23.210754 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053b214-d60d-4010-9346-37e5237e631f None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:05:23.212155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5053b214-d60d-4010-9346-37e5237e631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:05:23.289571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053b214-d60d-4010-9346-37e5237e631f None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:05:23.295923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e12760-567b-4344-b130-bb10ac4686a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:05:23.297240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e12760-567b-4344-b130-bb10ac4686a7 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:05:23.297240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e12760-567b-4344-b130-bb10ac4686a7 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:05:23.297240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e12760-567b-4344-b130-bb10ac4686a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:05:23.298943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e4e12760-567b-4344-b130-bb10ac4686a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:05:23.312374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e12760-567b-4344-b130-bb10ac4686a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:05:23.313984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e12760-567b-4344-b130-bb10ac4686a7 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:05:23.325488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1214/2423] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:05:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:05:33.320503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=34 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:05:59.740262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad756a3b-8725-4b17-ace2-14fc38143d2b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:05:59.740863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad756a3b-8725-4b17-ace2-14fc38143d2b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:05:59.740863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad756a3b-8725-4b17-ace2-14fc38143d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:05:59.761975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ad756a3b-8725-4b17-ace2-14fc38143d2b None None] MFA Rules not processed for user `e395d0436d2443f5a6e55e137d375549`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:05:59.763268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ad756a3b-8725-4b17-ace2-14fc38143d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:05:59.823751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1210/2424] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:05:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:00.148223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e12760-567b-4344-b130-bb10ac4686a7 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:00.159172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e12760-567b-4344-b130-bb10ac4686a7 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:00.163342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:00.163959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:00.164236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:00.164515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:00.166404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:00.178921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:00.180440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:00.189609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1215/2425] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:09.816545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=25 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:10.185346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=6 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:12.412094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad756a3b-8725-4b17-ace2-14fc38143d2b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:12.422190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad756a3b-8725-4b17-ace2-14fc38143d2b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:12.425893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:12.426488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:12.426763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:12.427029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:12.428743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:12.500245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:12.502196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:12.515900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1211/2426] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:16.435435 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:16.437660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:16.521908 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75720e59-1b9a-49c1-8fd0-302ac08740b6 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:16.527203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3877-3337-49c7-9bbd-051dc78bdda6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:16.527939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3877-3337-49c7-9bbd-051dc78bdda6 service placement] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:16.528292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3877-3337-49c7-9bbd-051dc78bdda6 service placement] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:16.528564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc3877-3337-49c7-9bbd-051dc78bdda6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:16.530411 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-aedc3877-3337-49c7-9bbd-051dc78bdda6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:16.544959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc3877-3337-49c7-9bbd-051dc78bdda6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:16.551654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc3877-3337-49c7-9bbd-051dc78bdda6 service placement] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:16.559669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:16.567047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:16.567190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1216/2427] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:16.579453 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b96dd3-9a84-4bbc-990c-9ff6bc409e2c service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:16.584632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:16.585547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:16.585547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:16.585800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] PATH_INFO: `/v3/users/49fc8627822f4765b08db422e7e580df` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:16.587215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fc8627822f4765b08db422e7e580df)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:16.589166 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:16.746243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fc8627822f4765b08db422e7e580df'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:16.746896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fc8627822f4765b08db422e7e580df'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:16.824152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fc8627822f4765b08db422e7e580df'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:16.832344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fc8627822f4765b08db422e7e580df'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:16.844582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-2d158978-9b78-4c6b-9b09-24f973fb7e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fc8627822f4765b08db422e7e580df'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:16.850815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1212/2428] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:06:16 2022] DELETE /identity/v3/users/49fc8627822f4765b08db422e7e580df => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:17.100697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3877-3337-49c7-9bbd-051dc78bdda6 service placement] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:17.113025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc3877-3337-49c7-9bbd-051dc78bdda6 service placement] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:17.184785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:17.185416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:17.185696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:17.185970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] PATH_INFO: `/v3/projects/1e56e536bbe8486ca8ad9ff518b2ced9` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:17.187323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e56e536bbe8486ca8ad9ff518b2ced9)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:17.189269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:17.292485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e56e536bbe8486ca8ad9ff518b2ced9', 'request_id': 'req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:17.299042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e56e536bbe8486ca8ad9ff518b2ced9', 'request_id': 'req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:17.305315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e56e536bbe8486ca8ad9ff518b2ced9', 'request_id': 'req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:17.378441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] The token cache is being invalidate because project 1e56e536bbe8486ca8ad9ff518b2ced9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:06:17.378885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:17.379963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-18b8d24f-4356-4d4d-9c5c-b54d38b275b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:17.381637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1217/2429] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:06:17 2022] DELETE /identity/v3/projects/1e56e536bbe8486ca8ad9ff518b2ced9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:17.388263 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36d1d9-78bb-4c7e-947d-64ffbc31796c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:17.388539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36d1d9-78bb-4c7e-947d-64ffbc31796c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:17.388810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36d1d9-78bb-4c7e-947d-64ffbc31796c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:17.410993 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3a36d1d9-78bb-4c7e-947d-64ffbc31796c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:17.412988 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3a36d1d9-78bb-4c7e-947d-64ffbc31796c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:17.484710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1213/2430] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:17.487506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6887bc-057c-4ae7-b157-07541590c6bb None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:17.488040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6887bc-057c-4ae7-b157-07541590c6bb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:17.488040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6887bc-057c-4ae7-b157-07541590c6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:17.508608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ff6887bc-057c-4ae7-b157-07541590c6bb None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:17.512024 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ff6887bc-057c-4ae7-b157-07541590c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:17.518139 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1218/2431] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:17.522653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36d1d9-78bb-4c7e-947d-64ffbc31796c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:17.534697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36d1d9-78bb-4c7e-947d-64ffbc31796c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:17.540034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dafb0-b623-4cc7-afbf-ffd009ce1c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:17.540743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dafb0-b623-4cc7-afbf-ffd009ce1c1b admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:17.541019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dafb0-b623-4cc7-afbf-ffd009ce1c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:17.541446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dafb0-b623-4cc7-afbf-ffd009ce1c1b admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:17.542608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dafb0-b623-4cc7-afbf-ffd009ce1c1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:06:17.542849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dafb0-b623-4cc7-afbf-ffd009ce1c1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:17.545429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dafb0-b623-4cc7-afbf-ffd009ce1c1b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:17.548584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:17.561898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1214/2432] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:06:17.566379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6887bc-057c-4ae7-b157-07541590c6bb None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:17.576402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6887bc-057c-4ae7-b157-07541590c6bb None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:17.582757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ddc3-fdda-425c-b61e-22e8be1af6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:17.583411 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ddc3-fdda-425c-b61e-22e8be1af6fb admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:17.583686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ddc3-fdda-425c-b61e-22e8be1af6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:17.583949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ddc3-fdda-425c-b61e-22e8be1af6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:17.584584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66ddc3-fdda-425c-b61e-22e8be1af6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:17.586816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66ddc3-fdda-425c-b61e-22e8be1af6fb admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:17.604036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:17.723700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1219/2433] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:06:17 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:06:17.727969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dafb0-b623-4cc7-afbf-ffd009ce1c1b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:17.738798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dafb0-b623-4cc7-afbf-ffd009ce1c1b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:17.802286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1de3a2-812e-45bd-b1d1-0d98da9cb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:17.802822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1de3a2-812e-45bd-b1d1-0d98da9cb096 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:17.803104 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1de3a2-812e-45bd-b1d1-0d98da9cb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:17.803410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1de3a2-812e-45bd-b1d1-0d98da9cb096 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:17.804070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1de3a2-812e-45bd-b1d1-0d98da9cb096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:17.806015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1de3a2-812e-45bd-b1d1-0d98da9cb096 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:17.923786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1215/2434] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:06:17 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:06:17.928340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ddc3-fdda-425c-b61e-22e8be1af6fb admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:17.940495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ddc3-fdda-425c-b61e-22e8be1af6fb admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:17.945673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a676bdc-0c70-445f-853f-d7ec6503118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:17.947041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a676bdc-0c70-445f-853f-d7ec6503118f admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:17.947633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a676bdc-0c70-445f-853f-d7ec6503118f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:17.947919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a676bdc-0c70-445f-853f-d7ec6503118f admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:17.948576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a676bdc-0c70-445f-853f-d7ec6503118f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:17.950691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a676bdc-0c70-445f-853f-d7ec6503118f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:17.961479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1220/2435] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:06:17.966298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1de3a2-812e-45bd-b1d1-0d98da9cb096 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:17.977317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1de3a2-812e-45bd-b1d1-0d98da9cb096 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:17.982031 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ab9d5-f0f3-4f6b-b842-82755f59e7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:17.982902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ab9d5-f0f3-4f6b-b842-82755f59e7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:17.983189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ab9d5-f0f3-4f6b-b842-82755f59e7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:17.983499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ab9d5-f0f3-4f6b-b842-82755f59e7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:17.984150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ab9d5-f0f3-4f6b-b842-82755f59e7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:17.985773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ab9d5-f0f3-4f6b-b842-82755f59e7d4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:17.997165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1216/2436] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:18.001643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a676bdc-0c70-445f-853f-d7ec6503118f admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:18.012191 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a676bdc-0c70-445f-853f-d7ec6503118f admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:18.018202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55b268-dcaa-4b88-80d3-42996d5a84b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:18.019026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55b268-dcaa-4b88-80d3-42996d5a84b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:18.019336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55b268-dcaa-4b88-80d3-42996d5a84b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:18.019606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55b268-dcaa-4b88-80d3-42996d5a84b4 admin admin] PATH_INFO: `/v3/projects/ef2d4ef39a664c17868fcc6e8ced2201/users/5242ef7e7a954d8997436c39a17a2fa6/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:18.037531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55b268-dcaa-4b88-80d3-42996d5a84b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2d4ef39a664c17868fcc6e8ced2201, user_id=5242ef7e7a954d8997436c39a17a2fa6, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:18.041701 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55b268-dcaa-4b88-80d3-42996d5a84b4 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:18.116603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1221/2437] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:18 2022] PUT /identity/v3/projects/ef2d4ef39a664c17868fcc6e8ced2201/users/5242ef7e7a954d8997436c39a17a2fa6/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:06:18.128731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f907b56-0953-4c4c-8a82-d0da882444a0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:18.129587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f907b56-0953-4c4c-8a82-d0da882444a0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:18.129587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f907b56-0953-4c4c-8a82-d0da882444a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:18.164501 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3f907b56-0953-4c4c-8a82-d0da882444a0 None None] MFA Rules not processed for user `5242ef7e7a954d8997436c39a17a2fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:18.165813 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3f907b56-0953-4c4c-8a82-d0da882444a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:18.242832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1217/2438] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:18.255493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55b268-dcaa-4b88-80d3-42996d5a84b4 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:18.257341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-9e55b268-dcaa-4b88-80d3-42996d5a84b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:18.337208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55b268-dcaa-4b88-80d3-42996d5a84b4 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:18.347090 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c0986-c9d0-4572-bf3f-ccb8943c3631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:18.347738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c0986-c9d0-4572-bf3f-ccb8943c3631 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:18.348018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c0986-c9d0-4572-bf3f-ccb8943c3631 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:18.350892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c0986-c9d0-4572-bf3f-ccb8943c3631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:18.357309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c0986-c9d0-4572-bf3f-ccb8943c3631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:18.359853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c0986-c9d0-4572-bf3f-ccb8943c3631 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:18.373722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1222/2439] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:21.699927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f907b56-0953-4c4c-8a82-d0da882444a0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:21.761239 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f907b56-0953-4c4c-8a82-d0da882444a0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:21.766534 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:21.767155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:21.767459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:21.767727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] PATH_INFO: `/v3/users/5242ef7e7a954d8997436c39a17a2fa6` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:21.768832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5242ef7e7a954d8997436c39a17a2fa6)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:21.770769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:21.773124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:21.987484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5242ef7e7a954d8997436c39a17a2fa6'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:21.988171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5242ef7e7a954d8997436c39a17a2fa6'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:22.067082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5242ef7e7a954d8997436c39a17a2fa6'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:22.075244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5242ef7e7a954d8997436c39a17a2fa6'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:22.088308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5242ef7e7a954d8997436c39a17a2fa6'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:22.094519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1218/2440] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:06:21 2022] DELETE /identity/v3/users/5242ef7e7a954d8997436c39a17a2fa6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:22.099312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a20a-0017-452f-9d7e-612f28dee996 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:22.099807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a20a-0017-452f-9d7e-612f28dee996 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:22.099925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7a20a-0017-452f-9d7e-612f28dee996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:22.120141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-23d7a20a-0017-452f-9d7e-612f28dee996 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:22.121379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-23d7a20a-0017-452f-9d7e-612f28dee996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:22.186115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1223/2441] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:22.198040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:22.199538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:22.266358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7006c6-5649-4e3d-acd6-80f0e04c6ae1 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:22.269865 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6c6e4-6fa9-463a-9739-20f2536cffdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:22.270473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6c6e4-6fa9-463a-9739-20f2536cffdd service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:22.270816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6c6e4-6fa9-463a-9739-20f2536cffdd service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:22.271088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6c6e4-6fa9-463a-9739-20f2536cffdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:22.280802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6c6e4-6fa9-463a-9739-20f2536cffdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:22.282233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6c6e4-6fa9-463a-9739-20f2536cffdd service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:22.291643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1219/2442] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:22.692270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a20a-0017-452f-9d7e-612f28dee996 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:22.693913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-23d7a20a-0017-452f-9d7e-612f28dee996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:22.712003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7a20a-0017-452f-9d7e-612f28dee996 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:22.718846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:22.719920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:22.720099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:22.720382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] PATH_INFO: `/v3/projects/ef2d4ef39a664c17868fcc6e8ced2201` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:22.721919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2d4ef39a664c17868fcc6e8ced2201)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:22.724262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:22.843342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:22.851772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2d4ef39a664c17868fcc6e8ced2201', 'request_id': 'req-1e8ad97a-4692-4264-80ca-074c82e94c05'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:22.857236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2d4ef39a664c17868fcc6e8ced2201', 'request_id': 'req-1e8ad97a-4692-4264-80ca-074c82e94c05'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:22.863885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2d4ef39a664c17868fcc6e8ced2201', 'request_id': 'req-1e8ad97a-4692-4264-80ca-074c82e94c05'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:22.964056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] The token cache is being invalidate because project ef2d4ef39a664c17868fcc6e8ced2201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:06:22.964346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:22.965000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1e8ad97a-4692-4264-80ca-074c82e94c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:22.966495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1224/2443] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:06:22 2022] DELETE /identity/v3/projects/ef2d4ef39a664c17868fcc6e8ced2201 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:22.972626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b1d9-3224-44c4-9dc0-3ad0170cb655 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:22.973168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b1d9-3224-44c4-9dc0-3ad0170cb655 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:22.973311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b1d9-3224-44c4-9dc0-3ad0170cb655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:22.993702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-db76b1d9-3224-44c4-9dc0-3ad0170cb655 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:22.994913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-db76b1d9-3224-44c4-9dc0-3ad0170cb655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:23.056061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1220/2444] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:23.064674 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a3f7-864f-4c9c-9387-d9fc7ece46ac None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.064956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a3f7-864f-4c9c-9387-d9fc7ece46ac None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.065296 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a3f7-864f-4c9c-9387-d9fc7ece46ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.085261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-1605a3f7-864f-4c9c-9387-d9fc7ece46ac None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:23.086388 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1605a3f7-864f-4c9c-9387-d9fc7ece46ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:23.094542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1225/2445] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:23.098893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b1d9-3224-44c4-9dc0-3ad0170cb655 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:23.109634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b1d9-3224-44c4-9dc0-3ad0170cb655 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:23.114273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a191af-4623-42fd-922a-feb2b96b53c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:23.114873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a191af-4623-42fd-922a-feb2b96b53c2 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.115195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a191af-4623-42fd-922a-feb2b96b53c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.115487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a191af-4623-42fd-922a-feb2b96b53c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.116137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a191af-4623-42fd-922a-feb2b96b53c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:06:23.116439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a191af-4623-42fd-922a-feb2b96b53c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:23.118042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a191af-4623-42fd-922a-feb2b96b53c2 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:23.130624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1221/2446] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:06:23.134960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605a3f7-864f-4c9c-9387-d9fc7ece46ac None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:23.144424 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605a3f7-864f-4c9c-9387-d9fc7ece46ac None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:23.149131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd3a0-e2d6-48dd-9655-3cb5072de89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:23.149726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd3a0-e2d6-48dd-9655-3cb5072de89e admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.150002 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd3a0-e2d6-48dd-9655-3cb5072de89e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.150272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd3a0-e2d6-48dd-9655-3cb5072de89e admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.150900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bd3a0-e2d6-48dd-9655-3cb5072de89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:23.152864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bd3a0-e2d6-48dd-9655-3cb5072de89e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:23.240076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1226/2447] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:06:23 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:23.244367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a191af-4623-42fd-922a-feb2b96b53c2 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:23.255319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a191af-4623-42fd-922a-feb2b96b53c2 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:23.264179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:23.322024 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f62c9f-f229-440d-bd40-88858fea44ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:23.322856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62c9f-f229-440d-bd40-88858fea44ad admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.323392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62c9f-f229-440d-bd40-88858fea44ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.323840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62c9f-f229-440d-bd40-88858fea44ad admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.324940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f62c9f-f229-440d-bd40-88858fea44ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:23.326867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f62c9f-f229-440d-bd40-88858fea44ad admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:23.421991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1222/2448] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:06:23 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:23.426370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd3a0-e2d6-48dd-9655-3cb5072de89e admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:23.437473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd3a0-e2d6-48dd-9655-3cb5072de89e admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:23.442076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a2ab8-8453-4a62-bb4b-bbf07401e764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:23.442673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a2ab8-8453-4a62-bb4b-bbf07401e764 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.442950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a2ab8-8453-4a62-bb4b-bbf07401e764 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.443235 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a2ab8-8453-4a62-bb4b-bbf07401e764 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.443891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a2ab8-8453-4a62-bb4b-bbf07401e764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:23.445495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a2ab8-8453-4a62-bb4b-bbf07401e764 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:23.456501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1227/2449] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:23.460765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f62c9f-f229-440d-bd40-88858fea44ad admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:23.471199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f62c9f-f229-440d-bd40-88858fea44ad admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:23.475961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ab9c5-ef79-4f72-8cb0-9ff1914d1400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:23.476565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab9c5-ef79-4f72-8cb0-9ff1914d1400 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.476848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab9c5-ef79-4f72-8cb0-9ff1914d1400 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.477122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ab9c5-ef79-4f72-8cb0-9ff1914d1400 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.477770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ab9c5-ef79-4f72-8cb0-9ff1914d1400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:23.479417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ab9c5-ef79-4f72-8cb0-9ff1914d1400 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:23.490786 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1223/2450] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:23.494903 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a2ab8-8453-4a62-bb4b-bbf07401e764 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:23.505465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a2ab8-8453-4a62-bb4b-bbf07401e764 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:23.509968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f53b-764c-4624-b801-8841a5ee2331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:23.510603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f53b-764c-4624-b801-8841a5ee2331 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.510885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f53b-764c-4624-b801-8841a5ee2331 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.511154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f53b-764c-4624-b801-8841a5ee2331 admin admin] PATH_INFO: `/v3/projects/3dbd4b95d6e24dfc8983007caed924e6/users/e69a28d92b9d4e34b961827778056d9d/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.526126 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9f53b-764c-4624-b801-8841a5ee2331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbd4b95d6e24dfc8983007caed924e6, user_id=e69a28d92b9d4e34b961827778056d9d, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:23.528891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9f53b-764c-4624-b801-8841a5ee2331 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:23.624399 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1228/2451] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:23 2022] PUT /identity/v3/projects/3dbd4b95d6e24dfc8983007caed924e6/users/e69a28d92b9d4e34b961827778056d9d/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:23.634679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a469c8d-9721-4561-9bca-7394ce9a272c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.634968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a469c8d-9721-4561-9bca-7394ce9a272c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.635269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a469c8d-9721-4561-9bca-7394ce9a272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.664039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-0a469c8d-9721-4561-9bca-7394ce9a272c None None] MFA Rules not processed for user `e69a28d92b9d4e34b961827778056d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:23.665322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0a469c8d-9721-4561-9bca-7394ce9a272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:23.729176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1224/2452] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:23.734610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f53b-764c-4624-b801-8841a5ee2331 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:23.797514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f53b-764c-4624-b801-8841a5ee2331 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:23.802262 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19231d15-12d7-438a-96cd-eddbf82d2ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:23.802866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19231d15-12d7-438a-96cd-eddbf82d2ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.803146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19231d15-12d7-438a-96cd-eddbf82d2ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.803452 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19231d15-12d7-438a-96cd-eddbf82d2ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.804083 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19231d15-12d7-438a-96cd-eddbf82d2ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:23.806016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19231d15-12d7-438a-96cd-eddbf82d2ab6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:23.884921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1229/2453] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:06:23 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:23.889063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a469c8d-9721-4561-9bca-7394ce9a272c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:23.899979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a469c8d-9721-4561-9bca-7394ce9a272c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:23.959407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1741689-3278-43a9-bcdb-84a1831078c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:23.960043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1741689-3278-43a9-bcdb-84a1831078c4 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:23.960319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1741689-3278-43a9-bcdb-84a1831078c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:23.960589 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1741689-3278-43a9-bcdb-84a1831078c4 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:23.961253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1741689-3278-43a9-bcdb-84a1831078c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:23.963278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1741689-3278-43a9-bcdb-84a1831078c4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:24.033423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1225/2454] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:06:23 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:24.037623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19231d15-12d7-438a-96cd-eddbf82d2ab6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:24.049889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19231d15-12d7-438a-96cd-eddbf82d2ab6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:24.054593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6bb3-9e64-431c-8a37-88a0ae082553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:24.055201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6bb3-9e64-431c-8a37-88a0ae082553 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:24.055644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6bb3-9e64-431c-8a37-88a0ae082553 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:24.057648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f6bb3-9e64-431c-8a37-88a0ae082553 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:24.057648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6bb3-9e64-431c-8a37-88a0ae082553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:24.058184 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f6bb3-9e64-431c-8a37-88a0ae082553 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:24.071674 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1230/2455] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:24.076588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1741689-3278-43a9-bcdb-84a1831078c4 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:24.087611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1741689-3278-43a9-bcdb-84a1831078c4 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:24.093548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69c49d-d819-4c64-8bed-19057cbd6620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:24.094289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69c49d-d819-4c64-8bed-19057cbd6620 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:24.094592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69c49d-d819-4c64-8bed-19057cbd6620 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:24.094868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69c49d-d819-4c64-8bed-19057cbd6620 admin admin] PATH_INFO: `/v3/projects/e3432d2660bf4e99b64ce619cb1ed8ab/users/add8733a04ef480dbd6a29fbc4945f65/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:24.098145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:24.111535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69c49d-d819-4c64-8bed-19057cbd6620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3432d2660bf4e99b64ce619cb1ed8ab, user_id=add8733a04ef480dbd6a29fbc4945f65, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:24.114536 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69c49d-d819-4c64-8bed-19057cbd6620 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:24.245355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1226/2456] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:24 2022] PUT /identity/v3/projects/e3432d2660bf4e99b64ce619cb1ed8ab/users/add8733a04ef480dbd6a29fbc4945f65/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:06:24.250199 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6bb3-9e64-431c-8a37-88a0ae082553 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:24.260761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f6bb3-9e64-431c-8a37-88a0ae082553 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:24.295246 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:24.320920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b671d7-fbf8-42fc-8455-fb6df6122b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:24.321629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b671d7-fbf8-42fc-8455-fb6df6122b7c admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:24.321910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b671d7-fbf8-42fc-8455-fb6df6122b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:24.322213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b671d7-fbf8-42fc-8455-fb6df6122b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:24.322843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b671d7-fbf8-42fc-8455-fb6df6122b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:24.324580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b671d7-fbf8-42fc-8455-fb6df6122b7c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:24.336245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1231/2457] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:24.340386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69c49d-d819-4c64-8bed-19057cbd6620 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:24.350898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69c49d-d819-4c64-8bed-19057cbd6620 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:24.355572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1d0c-a3c4-497b-95fc-da446f345361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:24.356219 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1d0c-a3c4-497b-95fc-da446f345361 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:24.356500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1d0c-a3c4-497b-95fc-da446f345361 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:24.356771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1d0c-a3c4-497b-95fc-da446f345361 admin admin] PATH_INFO: `/v3/projects/e3432d2660bf4e99b64ce619cb1ed8ab/users/add8733a04ef480dbd6a29fbc4945f65/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:24.358969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1d0c-a3c4-497b-95fc-da446f345361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3432d2660bf4e99b64ce619cb1ed8ab, user_id=add8733a04ef480dbd6a29fbc4945f65, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:24.361701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1d0c-a3c4-497b-95fc-da446f345361 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:24.372055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1227/2458] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:24 2022] PUT /identity/v3/projects/e3432d2660bf4e99b64ce619cb1ed8ab/users/add8733a04ef480dbd6a29fbc4945f65/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:06:24.383894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f5883-587a-4bd5-8ddb-18a384e2a2fd None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:24.384180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f5883-587a-4bd5-8ddb-18a384e2a2fd None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:24.384455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f5883-587a-4bd5-8ddb-18a384e2a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:24.413817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-103f5883-587a-4bd5-8ddb-18a384e2a2fd None None] MFA Rules not processed for user `add8733a04ef480dbd6a29fbc4945f65`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:24.415038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-103f5883-587a-4bd5-8ddb-18a384e2a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:24.484394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1232/2459] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:24.495994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1d0c-a3c4-497b-95fc-da446f345361 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:24.497674 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-03ed1d0c-a3c4-497b-95fc-da446f345361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:24.555090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1d0c-a3c4-497b-95fc-da446f345361 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:24.558763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8e275-da9d-4947-83e1-50a3b5481065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:24.559396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e275-da9d-4947-83e1-50a3b5481065 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:24.559678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e275-da9d-4947-83e1-50a3b5481065 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:24.559952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8e275-da9d-4947-83e1-50a3b5481065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:24.569409 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8e275-da9d-4947-83e1-50a3b5481065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:24.570848 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8e275-da9d-4947-83e1-50a3b5481065 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:24.580352 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1228/2460] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:25.478208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f5883-587a-4bd5-8ddb-18a384e2a2fd None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:25.542577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f5883-587a-4bd5-8ddb-18a384e2a2fd None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:25.547775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:25.548402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:25.548677 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:25.548948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] PATH_INFO: `/v3/users/e69a28d92b9d4e34b961827778056d9d` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:25.550142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69a28d92b9d4e34b961827778056d9d)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:25.552135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:25.690283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69a28d92b9d4e34b961827778056d9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:25.690965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69a28d92b9d4e34b961827778056d9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:25.698179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69a28d92b9d4e34b961827778056d9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:25.700955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:25.778031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69a28d92b9d4e34b961827778056d9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:25.791585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69a28d92b9d4e34b961827778056d9d'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:25.798565 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1233/2461] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:06:25 2022] DELETE /identity/v3/users/e69a28d92b9d4e34b961827778056d9d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:25.803341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0a70-2616-4c42-a6aa-edb9b699e072 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:25.803815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0a70-2616-4c42-a6aa-edb9b699e072 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:25.803945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d0a70-2616-4c42-a6aa-edb9b699e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:25.823961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-bb0d0a70-2616-4c42-a6aa-edb9b699e072 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:25.825224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bb0d0a70-2616-4c42-a6aa-edb9b699e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:25.886857 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1229/2462] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:25.898320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:25.899836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:25.968488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604044e7-7523-490f-a264-d899455e7fff admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:25.972575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1788-957b-4608-b246-7f7cb8e37afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:25.973207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1788-957b-4608-b246-7f7cb8e37afe service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:25.973483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1788-957b-4608-b246-7f7cb8e37afe service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:25.973757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b1788-957b-4608-b246-7f7cb8e37afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:25.986356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1788-957b-4608-b246-7f7cb8e37afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:25.987891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b1788-957b-4608-b246-7f7cb8e37afe service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:25.998451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1234/2463] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:26.451500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0a70-2616-4c42-a6aa-edb9b699e072 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:26.453214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bb0d0a70-2616-4c42-a6aa-edb9b699e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:26.465701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d0a70-2616-4c42-a6aa-edb9b699e072 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:26.471530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:26.472195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:26.472477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:26.472748 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] PATH_INFO: `/v3/projects/3dbd4b95d6e24dfc8983007caed924e6` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:26.473912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbd4b95d6e24dfc8983007caed924e6)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:26.475916 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:26.585742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbd4b95d6e24dfc8983007caed924e6', 'request_id': 'req-b7f71a9b-4840-4a37-9efb-25da8a27e648'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:26.592020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbd4b95d6e24dfc8983007caed924e6', 'request_id': 'req-b7f71a9b-4840-4a37-9efb-25da8a27e648'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:26.652514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbd4b95d6e24dfc8983007caed924e6', 'request_id': 'req-b7f71a9b-4840-4a37-9efb-25da8a27e648'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:26.660926 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:26.665442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] The token cache is being invalidate because project 3dbd4b95d6e24dfc8983007caed924e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:06:26.665739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:26.666391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:26.667928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1230/2464] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:06:26 2022] DELETE /identity/v3/projects/3dbd4b95d6e24dfc8983007caed924e6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:26.672757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1788-957b-4608-b246-7f7cb8e37afe service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:26.683547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b1788-957b-4608-b246-7f7cb8e37afe service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:26.746005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:26.746644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:26.746930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:26.747252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] PATH_INFO: `/v3/users/add8733a04ef480dbd6a29fbc4945f65` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:26.748419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=add8733a04ef480dbd6a29fbc4945f65)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:26.750431 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:26.884779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add8733a04ef480dbd6a29fbc4945f65'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:26.885403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add8733a04ef480dbd6a29fbc4945f65'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:26.893519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add8733a04ef480dbd6a29fbc4945f65'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:26.989533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add8733a04ef480dbd6a29fbc4945f65'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:27.002786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d2d7ecb7-4e70-4992-a678-64a54474b7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add8733a04ef480dbd6a29fbc4945f65'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:27.004374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:27.009508 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1235/2465] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:06:26 2022] DELETE /identity/v3/users/add8733a04ef480dbd6a29fbc4945f65 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:27.435567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:27.441807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:27.455418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f71a9b-4840-4a37-9efb-25da8a27e648 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:27.515960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:27.516598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:27.516876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:27.517146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] PATH_INFO: `/v3/projects/e3432d2660bf4e99b64ce619cb1ed8ab` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:27.518286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3432d2660bf4e99b64ce619cb1ed8ab)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:27.520241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:27.629084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3432d2660bf4e99b64ce619cb1ed8ab', 'request_id': 'req-59f83bfd-2dd9-4491-b2f9-5acb224963e2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:27.635547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3432d2660bf4e99b64ce619cb1ed8ab', 'request_id': 'req-59f83bfd-2dd9-4491-b2f9-5acb224963e2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:27.729760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3432d2660bf4e99b64ce619cb1ed8ab', 'request_id': 'req-59f83bfd-2dd9-4491-b2f9-5acb224963e2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:27.742070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] The token cache is being invalidate because project e3432d2660bf4e99b64ce619cb1ed8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:06:27.742359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:27.743005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-59f83bfd-2dd9-4491-b2f9-5acb224963e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:27.746283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1231/2466] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:06:27 2022] DELETE /identity/v3/projects/e3432d2660bf4e99b64ce619cb1ed8ab => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:06:27.751692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30052b-ae8c-45fb-9103-07e611b49e9d None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:27.752177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30052b-ae8c-45fb-9103-07e611b49e9d None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:27.752335 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30052b-ae8c-45fb-9103-07e611b49e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:27.772921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-1a30052b-ae8c-45fb-9103-07e611b49e9d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:27.774082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1a30052b-ae8c-45fb-9103-07e611b49e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:27.834426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1236/2467] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:06:27.842115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98499d-0ec4-412c-b330-03f1d418c6d0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:27.842430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98499d-0ec4-412c-b330-03f1d418c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:27.842770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98499d-0ec4-412c-b330-03f1d418c6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:27.862913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-9d98499d-0ec4-412c-b330-03f1d418c6d0 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:27.864138 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9d98499d-0ec4-412c-b330-03f1d418c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:27.872156 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1232/2468] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:27.877534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30052b-ae8c-45fb-9103-07e611b49e9d None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:27.887598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30052b-ae8c-45fb-9103-07e611b49e9d None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:27.892196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb7f56-e20c-453a-b838-8e6da1b99d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:27.892788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb7f56-e20c-453a-b838-8e6da1b99d87 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:27.893066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb7f56-e20c-453a-b838-8e6da1b99d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:27.893338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb7f56-e20c-453a-b838-8e6da1b99d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:27.893986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb7f56-e20c-453a-b838-8e6da1b99d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:06:27.894287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb7f56-e20c-453a-b838-8e6da1b99d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:27.895991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb7f56-e20c-453a-b838-8e6da1b99d87 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:27.908396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1237/2469] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:06:27.912906 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98499d-0ec4-412c-b330-03f1d418c6d0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:27.923069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98499d-0ec4-412c-b330-03f1d418c6d0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:27.927811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd57cf-154b-41cc-bd90-fa2372264bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:27.928421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd57cf-154b-41cc-bd90-fa2372264bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:27.928690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd57cf-154b-41cc-bd90-fa2372264bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:27.928963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd57cf-154b-41cc-bd90-fa2372264bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:27.929592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd57cf-154b-41cc-bd90-fa2372264bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:27.931606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd57cf-154b-41cc-bd90-fa2372264bb4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:28.022542 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1233/2470] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:06:27 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:28.026666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb7f56-e20c-453a-b838-8e6da1b99d87 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:28.038118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb7f56-e20c-453a-b838-8e6da1b99d87 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:28.100917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e2e1c-a4de-447a-925f-9600e4a00fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:28.101556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e2e1c-a4de-447a-925f-9600e4a00fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:28.101829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e2e1c-a4de-447a-925f-9600e4a00fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:28.102096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e2e1c-a4de-447a-925f-9600e4a00fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:28.102722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e2e1c-a4de-447a-925f-9600e4a00fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:28.104952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e2e1c-a4de-447a-925f-9600e4a00fc0 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:28.218417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1238/2471] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:06:28 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:28.222710 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd57cf-154b-41cc-bd90-fa2372264bb4 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:28.233591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd57cf-154b-41cc-bd90-fa2372264bb4 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:28.239181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7f65a-9986-4dde-9280-2476451fc0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:28.239181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7f65a-9986-4dde-9280-2476451fc0eb admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:28.239181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7f65a-9986-4dde-9280-2476451fc0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:28.239628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7f65a-9986-4dde-9280-2476451fc0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:28.239953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7f65a-9986-4dde-9280-2476451fc0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:28.241554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7f65a-9986-4dde-9280-2476451fc0eb admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:28.252829 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1234/2472] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:28.257010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e2e1c-a4de-447a-925f-9600e4a00fc0 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:28.268491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e2e1c-a4de-447a-925f-9600e4a00fc0 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:28.273257 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8572562-9564-4ba0-99f8-20dde68360d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:28.273925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8572562-9564-4ba0-99f8-20dde68360d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:28.274371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8572562-9564-4ba0-99f8-20dde68360d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:28.274648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8572562-9564-4ba0-99f8-20dde68360d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:28.275324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8572562-9564-4ba0-99f8-20dde68360d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:28.276944 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8572562-9564-4ba0-99f8-20dde68360d5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:28.289231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1239/2473] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:28.294042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7f65a-9986-4dde-9280-2476451fc0eb admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:28.304887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7f65a-9986-4dde-9280-2476451fc0eb admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:28.309508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32154c-1a01-47ee-9a50-3bb1a513a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:28.318358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32154c-1a01-47ee-9a50-3bb1a513a63c admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:28.318358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32154c-1a01-47ee-9a50-3bb1a513a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:28.318358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32154c-1a01-47ee-9a50-3bb1a513a63c admin admin] PATH_INFO: `/v3/projects/0f66cb82dd83444ca0d99c198ffcf9ed/users/e4eff24b296b41cbba4e6c87dd705271/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:28.327292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32154c-1a01-47ee-9a50-3bb1a513a63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f66cb82dd83444ca0d99c198ffcf9ed, user_id=e4eff24b296b41cbba4e6c87dd705271, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:28.329980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32154c-1a01-47ee-9a50-3bb1a513a63c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:28.418810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1235/2474] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:28 2022] PUT /identity/v3/projects/0f66cb82dd83444ca0d99c198ffcf9ed/users/e4eff24b296b41cbba4e6c87dd705271/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:28.430046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69b4e7-d497-4497-8ddc-92871a7234c6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:28.430324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69b4e7-d497-4497-8ddc-92871a7234c6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:28.430595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69b4e7-d497-4497-8ddc-92871a7234c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:28.462723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ae69b4e7-d497-4497-8ddc-92871a7234c6 None None] MFA Rules not processed for user `e4eff24b296b41cbba4e6c87dd705271`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:28.464081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ae69b4e7-d497-4497-8ddc-92871a7234c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:28.527367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:28.538190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1240/2475] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:28.542743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32154c-1a01-47ee-9a50-3bb1a513a63c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:28.571989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:28.611362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32154c-1a01-47ee-9a50-3bb1a513a63c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:28.616423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773b663-05e3-43bc-b69d-8c3eaa9dfe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:28.617103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773b663-05e3-43bc-b69d-8c3eaa9dfe15 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:28.617340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773b663-05e3-43bc-b69d-8c3eaa9dfe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:28.617611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773b663-05e3-43bc-b69d-8c3eaa9dfe15 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:28.618261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773b663-05e3-43bc-b69d-8c3eaa9dfe15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:28.620253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773b663-05e3-43bc-b69d-8c3eaa9dfe15 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:28.716114 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1236/2476] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:06:28 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:06:28.720498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69b4e7-d497-4497-8ddc-92871a7234c6 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:28.731891 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69b4e7-d497-4497-8ddc-92871a7234c6 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:28.802401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a85d2-66da-419b-ba02-c3c1f13791d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:28.803077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a85d2-66da-419b-ba02-c3c1f13791d2 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:28.803176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a85d2-66da-419b-ba02-c3c1f13791d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:28.803469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a85d2-66da-419b-ba02-c3c1f13791d2 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:28.804099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a85d2-66da-419b-ba02-c3c1f13791d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:28.806061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a85d2-66da-419b-ba02-c3c1f13791d2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:28.897055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1241/2477] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:06:28 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:06:28.901154 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773b663-05e3-43bc-b69d-8c3eaa9dfe15 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:28.912034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773b663-05e3-43bc-b69d-8c3eaa9dfe15 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:28.916592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e83cb-9a62-4070-8e69-b1108494b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:28.917199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e83cb-9a62-4070-8e69-b1108494b520 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:28.917478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e83cb-9a62-4070-8e69-b1108494b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:28.917747 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e83cb-9a62-4070-8e69-b1108494b520 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:28.918390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e83cb-9a62-4070-8e69-b1108494b520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:28.920051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e83cb-9a62-4070-8e69-b1108494b520 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:28.931401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1237/2478] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:28.935772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a85d2-66da-419b-ba02-c3c1f13791d2 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:28.946617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a85d2-66da-419b-ba02-c3c1f13791d2 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:28.951192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cde39-a3aa-486f-a96b-2a769d95cc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:28.951960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cde39-a3aa-486f-a96b-2a769d95cc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:28.952771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cde39-a3aa-486f-a96b-2a769d95cc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:28.953044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cde39-a3aa-486f-a96b-2a769d95cc20 admin admin] PATH_INFO: `/v3/projects/b87db8dd847545589b0ba71dd2290a82/users/f65ca95bb01c44b38006a3264f02daaf/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:28.969018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cde39-a3aa-486f-a96b-2a769d95cc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87db8dd847545589b0ba71dd2290a82, user_id=f65ca95bb01c44b38006a3264f02daaf, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:28.971739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cde39-a3aa-486f-a96b-2a769d95cc20 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:29.027784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1242/2479] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:28 2022] PUT /identity/v3/projects/b87db8dd847545589b0ba71dd2290a82/users/f65ca95bb01c44b38006a3264f02daaf/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:29.032762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e83cb-9a62-4070-8e69-b1108494b520 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:29.043260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e83cb-9a62-4070-8e69-b1108494b520 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:29.101794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f86f7-211d-4e01-9b57-73e26e1c6242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:29.102323 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f86f7-211d-4e01-9b57-73e26e1c6242 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:29.102601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f86f7-211d-4e01-9b57-73e26e1c6242 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:29.102871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f86f7-211d-4e01-9b57-73e26e1c6242 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:29.103546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f86f7-211d-4e01-9b57-73e26e1c6242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:29.105143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f86f7-211d-4e01-9b57-73e26e1c6242 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:29.115597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1238/2480] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:29.119681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cde39-a3aa-486f-a96b-2a769d95cc20 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:29.130348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cde39-a3aa-486f-a96b-2a769d95cc20 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:29.135017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e420-3c58-40c8-80de-cf74981f6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:29.135694 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e420-3c58-40c8-80de-cf74981f6bad admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:29.140995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e420-3c58-40c8-80de-cf74981f6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:29.140995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e420-3c58-40c8-80de-cf74981f6bad admin admin] PATH_INFO: `/v3/projects/b87db8dd847545589b0ba71dd2290a82/users/f65ca95bb01c44b38006a3264f02daaf/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:29.140995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208e420-3c58-40c8-80de-cf74981f6bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87db8dd847545589b0ba71dd2290a82, user_id=f65ca95bb01c44b38006a3264f02daaf, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:29.141438 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208e420-3c58-40c8-80de-cf74981f6bad admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:29.151606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1243/2481] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:29 2022] PUT /identity/v3/projects/b87db8dd847545589b0ba71dd2290a82/users/f65ca95bb01c44b38006a3264f02daaf/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:29.163502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44655dc7-ec44-4cf4-af31-6bcaef469c39 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:29.163806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44655dc7-ec44-4cf4-af31-6bcaef469c39 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:29.164192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44655dc7-ec44-4cf4-af31-6bcaef469c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:29.192181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-44655dc7-ec44-4cf4-af31-6bcaef469c39 None None] MFA Rules not processed for user `f65ca95bb01c44b38006a3264f02daaf`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:29.193397 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-44655dc7-ec44-4cf4-af31-6bcaef469c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:29.262182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1239/2482] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:29.273278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e420-3c58-40c8-80de-cf74981f6bad admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:29.274960 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1208e420-3c58-40c8-80de-cf74981f6bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:29.333300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e420-3c58-40c8-80de-cf74981f6bad admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:29.336966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb7c60-e8ec-4074-bba6-f17797957d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:29.337559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb7c60-e8ec-4074-bba6-f17797957d2d service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:29.337838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb7c60-e8ec-4074-bba6-f17797957d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:29.338112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb7c60-e8ec-4074-bba6-f17797957d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:29.395359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb7c60-e8ec-4074-bba6-f17797957d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:29.396731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb7c60-e8ec-4074-bba6-f17797957d2d service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:29.401563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:29.406844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1244/2483] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:32.609118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44655dc7-ec44-4cf4-af31-6bcaef469c39 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:32.618839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44655dc7-ec44-4cf4-af31-6bcaef469c39 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:32.622453 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87400fe-93c8-48b2-97b9-302c8cd03f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:32.623048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87400fe-93c8-48b2-97b9-302c8cd03f30 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:32.623365 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87400fe-93c8-48b2-97b9-302c8cd03f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:32.624135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87400fe-93c8-48b2-97b9-302c8cd03f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:32.636299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87400fe-93c8-48b2-97b9-302c8cd03f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:32.639121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87400fe-93c8-48b2-97b9-302c8cd03f30 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:32.652211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1240/2484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:42.648029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:47.549832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb7c60-e8ec-4074-bba6-f17797957d2d service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:47.612333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb7c60-e8ec-4074-bba6-f17797957d2d service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:47.616948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:47.617580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:47.617849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:47.618121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] PATH_INFO: `/v3/users/e4eff24b296b41cbba4e6c87dd705271` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:47.619260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4eff24b296b41cbba4e6c87dd705271)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:47.621204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:47.791243 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4eff24b296b41cbba4e6c87dd705271'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:47.791909 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4eff24b296b41cbba4e6c87dd705271'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:47.799398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4eff24b296b41cbba4e6c87dd705271'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:47.868925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4eff24b296b41cbba4e6c87dd705271'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:47.882498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4eff24b296b41cbba4e6c87dd705271'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:47.888849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1245/2485] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:06:47 2022] DELETE /identity/v3/users/e4eff24b296b41cbba4e6c87dd705271 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:47.893474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9809e-d4b7-4729-ac49-cea151535280 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:47.893985 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9809e-d4b7-4729-ac49-cea151535280 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:47.894088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9809e-d4b7-4729-ac49-cea151535280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:47.912998 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-cec9809e-d4b7-4729-ac49-cea151535280 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:47.914221 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cec9809e-d4b7-4729-ac49-cea151535280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:47.972569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1241/2486] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:47.982340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:47.984352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:48.040443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b0f94-48e6-4297-bbde-ccf701a2641a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:48.044350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252743b-b464-4fb3-9661-a4699eb13a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:48.044875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252743b-b464-4fb3-9661-a4699eb13a1a service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:48.045147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252743b-b464-4fb3-9661-a4699eb13a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:48.045415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252743b-b464-4fb3-9661-a4699eb13a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:48.055165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252743b-b464-4fb3-9661-a4699eb13a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:48.056622 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252743b-b464-4fb3-9661-a4699eb13a1a service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:48.066701 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1246/2487] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:48.454213 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9809e-d4b7-4729-ac49-cea151535280 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:48.455554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cec9809e-d4b7-4729-ac49-cea151535280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:48.468558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9809e-d4b7-4729-ac49-cea151535280 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:48.473308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:48.473954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:48.474229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:48.474530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] PATH_INFO: `/v3/projects/0f66cb82dd83444ca0d99c198ffcf9ed` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:48.475688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f66cb82dd83444ca0d99c198ffcf9ed)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:48.477643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:48.574967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f66cb82dd83444ca0d99c198ffcf9ed', 'request_id': 'req-c3a15474-af8d-46d3-a969-c467d4a331a7'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:48.581658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f66cb82dd83444ca0d99c198ffcf9ed', 'request_id': 'req-c3a15474-af8d-46d3-a969-c467d4a331a7'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:48.657875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f66cb82dd83444ca0d99c198ffcf9ed', 'request_id': 'req-c3a15474-af8d-46d3-a969-c467d4a331a7'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:48.660073 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252743b-b464-4fb3-9661-a4699eb13a1a service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:48.661558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1252743b-b464-4fb3-9661-a4699eb13a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:48.669359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] The token cache is being invalidate because project 0f66cb82dd83444ca0d99c198ffcf9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:06:48.669649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:48.670387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:48.672197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1242/2488] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:06:48 2022] DELETE /identity/v3/projects/0f66cb82dd83444ca0d99c198ffcf9ed => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:48.673736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252743b-b464-4fb3-9661-a4699eb13a1a service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:48.676065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:48.677401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:48.692982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:48.726110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc1bd-a229-4adb-b5ea-d5f06cab8928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:48.726730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc1bd-a229-4adb-b5ea-d5f06cab8928 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:48.727011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc1bd-a229-4adb-b5ea-d5f06cab8928 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:48.727335 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cc1bd-a229-4adb-b5ea-d5f06cab8928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:48.729113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5b2cc1bd-a229-4adb-b5ea-d5f06cab8928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:48.745819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a15474-af8d-46d3-a969-c467d4a331a7 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:48.750905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:48.751814 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:48.751984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:48.752133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] PATH_INFO: `/v3/users/f65ca95bb01c44b38006a3264f02daaf` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:48.753470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65ca95bb01c44b38006a3264f02daaf)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:48.755489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:48.794002 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc1bd-a229-4adb-b5ea-d5f06cab8928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:48.795479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cc1bd-a229-4adb-b5ea-d5f06cab8928 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:48.804841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1247/2489] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:06:48.855708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:48.972860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65ca95bb01c44b38006a3264f02daaf'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:48.973521 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65ca95bb01c44b38006a3264f02daaf'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:49.054860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65ca95bb01c44b38006a3264f02daaf'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:49.062724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65ca95bb01c44b38006a3264f02daaf'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:49.075280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-833700c9-8778-448d-b414-7199b857d6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65ca95bb01c44b38006a3264f02daaf'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:49.081708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1243/2490] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:06:48 2022] DELETE /identity/v3/users/f65ca95bb01c44b38006a3264f02daaf => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:06:49.813662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc1bd-a229-4adb-b5ea-d5f06cab8928 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:49.825628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cc1bd-a229-4adb-b5ea-d5f06cab8928 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:49.897063 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:49.898012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:49.898473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:49.898913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] PATH_INFO: `/v3/projects/b87db8dd847545589b0ba71dd2290a82` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:49.900366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87db8dd847545589b0ba71dd2290a82)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:49.902871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:50.032876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87db8dd847545589b0ba71dd2290a82', 'request_id': 'req-a4017407-24e4-422c-ae9a-634d775ddce7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:50.039130 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87db8dd847545589b0ba71dd2290a82', 'request_id': 'req-a4017407-24e4-422c-ae9a-634d775ddce7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:50.046464 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87db8dd847545589b0ba71dd2290a82', 'request_id': 'req-a4017407-24e4-422c-ae9a-634d775ddce7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:50.117526 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] The token cache is being invalidate because project b87db8dd847545589b0ba71dd2290a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:06:50.118155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:50.119080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a4017407-24e4-422c-ae9a-634d775ddce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:06:50.121161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1248/2491] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:06:49 2022] DELETE /identity/v3/projects/b87db8dd847545589b0ba71dd2290a82 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:50.127082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa656a-0b42-4fc1-b682-97fbf5b35ca8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:50.127576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa656a-0b42-4fc1-b682-97fbf5b35ca8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:50.127683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa656a-0b42-4fc1-b682-97fbf5b35ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:50.150210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-beaa656a-0b42-4fc1-b682-97fbf5b35ca8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:50.151544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-beaa656a-0b42-4fc1-b682-97fbf5b35ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:50.230782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1244/2492] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:50.240023 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b372b0-022e-4a92-a22f-0bff8df9ac59 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:50.240585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b372b0-022e-4a92-a22f-0bff8df9ac59 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:50.240991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b372b0-022e-4a92-a22f-0bff8df9ac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:50.257094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:50.262775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-c1b372b0-022e-4a92-a22f-0bff8df9ac59 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:50.264051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c1b372b0-022e-4a92-a22f-0bff8df9ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:50.276198 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1249/2493] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:50.278246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa656a-0b42-4fc1-b682-97fbf5b35ca8 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:50.290915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa656a-0b42-4fc1-b682-97fbf5b35ca8 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:50.299060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836fcd-aba6-45be-965d-225ea35e9a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:50.300433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836fcd-aba6-45be-965d-225ea35e9a80 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:50.300992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836fcd-aba6-45be-965d-225ea35e9a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:50.303261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836fcd-aba6-45be-965d-225ea35e9a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:50.303958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e836fcd-aba6-45be-965d-225ea35e9a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:06:50.304270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e836fcd-aba6-45be-965d-225ea35e9a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:50.306288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e836fcd-aba6-45be-965d-225ea35e9a80 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:50.323428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1245/2494] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:06:50.326028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b372b0-022e-4a92-a22f-0bff8df9ac59 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:50.338016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b372b0-022e-4a92-a22f-0bff8df9ac59 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:50.344556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf025-dea6-44bc-a752-2e16257f04e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:50.347458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf025-dea6-44bc-a752-2e16257f04e9 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:50.347458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf025-dea6-44bc-a752-2e16257f04e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:50.347458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf025-dea6-44bc-a752-2e16257f04e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:50.347945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdf025-dea6-44bc-a752-2e16257f04e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:50.350101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdf025-dea6-44bc-a752-2e16257f04e9 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:50.449211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1250/2495] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:06:50 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:06:50.453729 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836fcd-aba6-45be-965d-225ea35e9a80 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:50.465685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836fcd-aba6-45be-965d-225ea35e9a80 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:50.530300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ae01-a869-4c5e-a268-241f5ac4fa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:50.531510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ae01-a869-4c5e-a268-241f5ac4fa33 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:50.531759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ae01-a869-4c5e-a268-241f5ac4fa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:50.532027 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5ae01-a869-4c5e-a268-241f5ac4fa33 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:50.532699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5ae01-a869-4c5e-a268-241f5ac4fa33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:50.534780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5ae01-a869-4c5e-a268-241f5ac4fa33 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:50.628293 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1246/2496] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:06:50 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:50.635584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf025-dea6-44bc-a752-2e16257f04e9 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:50.648798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf025-dea6-44bc-a752-2e16257f04e9 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:50.653629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98873ada-eee1-48f7-974e-2f60229a7753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:50.654234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98873ada-eee1-48f7-974e-2f60229a7753 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:50.654514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98873ada-eee1-48f7-974e-2f60229a7753 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:50.654788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98873ada-eee1-48f7-974e-2f60229a7753 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:50.656173 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98873ada-eee1-48f7-974e-2f60229a7753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:50.657930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98873ada-eee1-48f7-974e-2f60229a7753 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:50.668983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1251/2497] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:50.673967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ae01-a869-4c5e-a268-241f5ac4fa33 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:50.684842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5ae01-a869-4c5e-a268-241f5ac4fa33 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:50.690285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983397a-78f0-4be2-b5db-18982ea48b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:50.690905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983397a-78f0-4be2-b5db-18982ea48b6f admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:50.691185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983397a-78f0-4be2-b5db-18982ea48b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:50.691491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983397a-78f0-4be2-b5db-18982ea48b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:50.692149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983397a-78f0-4be2-b5db-18982ea48b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:50.693846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983397a-78f0-4be2-b5db-18982ea48b6f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:50.707934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1247/2498] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:50.712109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98873ada-eee1-48f7-974e-2f60229a7753 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:50.724620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98873ada-eee1-48f7-974e-2f60229a7753 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:50.730403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f3f48-9b95-47d3-86e4-1ef56804f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:50.731543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f3f48-9b95-47d3-86e4-1ef56804f1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:50.731830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f3f48-9b95-47d3-86e4-1ef56804f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:50.732365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f3f48-9b95-47d3-86e4-1ef56804f1a0 admin admin] PATH_INFO: `/v3/projects/6df5bae32578495fb58326a61e4c5fb6/users/0cff0da3c8334a94b3d8d97c4fecb730/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:50.753282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f3f48-9b95-47d3-86e4-1ef56804f1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df5bae32578495fb58326a61e4c5fb6, user_id=0cff0da3c8334a94b3d8d97c4fecb730, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:50.756014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f3f48-9b95-47d3-86e4-1ef56804f1a0 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:50.847454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1252/2499] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:50 2022] PUT /identity/v3/projects/6df5bae32578495fb58326a61e4c5fb6/users/0cff0da3c8334a94b3d8d97c4fecb730/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:50.859634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd640866-ee9a-43f5-8027-2720ecbd07c8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:50.859925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd640866-ee9a-43f5-8027-2720ecbd07c8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:50.860203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd640866-ee9a-43f5-8027-2720ecbd07c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:50.880002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:50.888755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-fd640866-ee9a-43f5-8027-2720ecbd07c8 None None] MFA Rules not processed for user `0cff0da3c8334a94b3d8d97c4fecb730`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:50.890662 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fd640866-ee9a-43f5-8027-2720ecbd07c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:50.957967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1248/2500] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:50.962498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f3f48-9b95-47d3-86e4-1ef56804f1a0 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:51.025276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f3f48-9b95-47d3-86e4-1ef56804f1a0 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:51.030195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b60f49-d1fd-41ab-9252-4e49016180c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:51.031765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b60f49-d1fd-41ab-9252-4e49016180c1 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.032061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b60f49-d1fd-41ab-9252-4e49016180c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.032412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b60f49-d1fd-41ab-9252-4e49016180c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.033049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b60f49-d1fd-41ab-9252-4e49016180c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:51.034989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b60f49-d1fd-41ab-9252-4e49016180c1 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:51.122660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1253/2501] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:06:50 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:51.127042 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd640866-ee9a-43f5-8027-2720ecbd07c8 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:51.138202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd640866-ee9a-43f5-8027-2720ecbd07c8 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:51.196960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab66a38-39db-4da2-8615-d0d49328f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:51.197575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab66a38-39db-4da2-8615-d0d49328f7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.197856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab66a38-39db-4da2-8615-d0d49328f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.198129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab66a38-39db-4da2-8615-d0d49328f7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.198861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab66a38-39db-4da2-8615-d0d49328f7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:51.200840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab66a38-39db-4da2-8615-d0d49328f7c0 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:51.258109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1249/2502] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:06:51 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:51.262258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b60f49-d1fd-41ab-9252-4e49016180c1 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:51.273817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b60f49-d1fd-41ab-9252-4e49016180c1 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:51.278485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6edf24-f255-4e85-9204-96da8d1a43db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:51.279065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6edf24-f255-4e85-9204-96da8d1a43db admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.279491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6edf24-f255-4e85-9204-96da8d1a43db admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.279769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6edf24-f255-4e85-9204-96da8d1a43db admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.280537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6edf24-f255-4e85-9204-96da8d1a43db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:51.282193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6edf24-f255-4e85-9204-96da8d1a43db admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:51.293096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1254/2503] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:51.297322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab66a38-39db-4da2-8615-d0d49328f7c0 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:51.307526 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab66a38-39db-4da2-8615-d0d49328f7c0 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:51.313092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb33a-1ebb-4f8e-85e0-3d0f24480ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:51.313700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb33a-1ebb-4f8e-85e0-3d0f24480ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.313977 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb33a-1ebb-4f8e-85e0-3d0f24480ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.314247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb33a-1ebb-4f8e-85e0-3d0f24480ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.314886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb33a-1ebb-4f8e-85e0-3d0f24480ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:51.316535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb33a-1ebb-4f8e-85e0-3d0f24480ac0 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:51.326794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1250/2504] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:51.331733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6edf24-f255-4e85-9204-96da8d1a43db admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:51.342868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6edf24-f255-4e85-9204-96da8d1a43db admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:51.348050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7cee-eb15-468d-9066-4a1f2427ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:51.348978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7cee-eb15-468d-9066-4a1f2427ea64 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.349107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7cee-eb15-468d-9066-4a1f2427ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.349292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d7cee-eb15-468d-9066-4a1f2427ea64 admin admin] PATH_INFO: `/v3/projects/ed329f77b2f548f19a60f13ae5fdf37b/users/fa1b7d8d82c84c00bbf0a8532a40e0ed/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.366308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d7cee-eb15-468d-9066-4a1f2427ea64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed329f77b2f548f19a60f13ae5fdf37b, user_id=fa1b7d8d82c84c00bbf0a8532a40e0ed, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:51.369182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d7cee-eb15-468d-9066-4a1f2427ea64 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:51.417870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1255/2505] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:51 2022] PUT /identity/v3/projects/ed329f77b2f548f19a60f13ae5fdf37b/users/fa1b7d8d82c84c00bbf0a8532a40e0ed/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:51.428479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b422-c7f4-48ad-ae6f-44198fce0ff3 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.428764 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b422-c7f4-48ad-ae6f-44198fce0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.429046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b422-c7f4-48ad-ae6f-44198fce0ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.458853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d267b422-c7f4-48ad-ae6f-44198fce0ff3 None None] MFA Rules not processed for user `fa1b7d8d82c84c00bbf0a8532a40e0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:51.460128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d267b422-c7f4-48ad-ae6f-44198fce0ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:51.525016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1251/2506] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:51.532709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7cee-eb15-468d-9066-4a1f2427ea64 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:51.585921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:51.595969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d7cee-eb15-468d-9066-4a1f2427ea64 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:51.600648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179da8-982f-4122-ba26-64deef5d6982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:51.601245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179da8-982f-4122-ba26-64deef5d6982 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.601519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179da8-982f-4122-ba26-64deef5d6982 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.601787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179da8-982f-4122-ba26-64deef5d6982 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.602459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2179da8-982f-4122-ba26-64deef5d6982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:51.604393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2179da8-982f-4122-ba26-64deef5d6982 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:51.709020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1256/2507] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:06:51 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:51.710128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267b422-c7f4-48ad-ae6f-44198fce0ff3 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:51.722183 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267b422-c7f4-48ad-ae6f-44198fce0ff3 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:51.726098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:51.783462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b3c47-202f-408a-bbd1-2f4f3309a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:51.784087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b3c47-202f-408a-bbd1-2f4f3309a3ed admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.784481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b3c47-202f-408a-bbd1-2f4f3309a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.784771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b3c47-202f-408a-bbd1-2f4f3309a3ed admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.785491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b3c47-202f-408a-bbd1-2f4f3309a3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:51.787518 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b3c47-202f-408a-bbd1-2f4f3309a3ed admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:51.872941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1252/2508] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:06:51 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:06:51.875302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179da8-982f-4122-ba26-64deef5d6982 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:51.887843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179da8-982f-4122-ba26-64deef5d6982 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:51.892233 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f71d7-e491-4760-b71c-cc22efba7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:51.892846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f71d7-e491-4760-b71c-cc22efba7c9f admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.893131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f71d7-e491-4760-b71c-cc22efba7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.893396 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f71d7-e491-4760-b71c-cc22efba7c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.894106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f71d7-e491-4760-b71c-cc22efba7c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:51.895790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f71d7-e491-4760-b71c-cc22efba7c9f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:51.907569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1257/2509] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:06:51.911842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b3c47-202f-408a-bbd1-2f4f3309a3ed admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:51.923064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b3c47-202f-408a-bbd1-2f4f3309a3ed admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:51.928804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63478bf9-3f40-4e16-a076-5a09d9400326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:51.929477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63478bf9-3f40-4e16-a076-5a09d9400326 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:51.929833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63478bf9-3f40-4e16-a076-5a09d9400326 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:51.930062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63478bf9-3f40-4e16-a076-5a09d9400326 admin admin] PATH_INFO: `/v3/projects/040a8aa829934eb980cf93c7ef64bf2e/users/06421ee0e8e948ed85c4c8a19b113a4e/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:51.947565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63478bf9-3f40-4e16-a076-5a09d9400326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040a8aa829934eb980cf93c7ef64bf2e, user_id=06421ee0e8e948ed85c4c8a19b113a4e, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:51.950276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63478bf9-3f40-4e16-a076-5a09d9400326 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:52.081039 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1253/2510] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:51 2022] PUT /identity/v3/projects/040a8aa829934eb980cf93c7ef64bf2e/users/06421ee0e8e948ed85c4c8a19b113a4e/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:52.085318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f71d7-e491-4760-b71c-cc22efba7c9f admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:52.097161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f71d7-e491-4760-b71c-cc22efba7c9f admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:52.154900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55a970-3b80-4cbe-a4f4-8bc523030ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:52.156074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55a970-3b80-4cbe-a4f4-8bc523030ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:52.156346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55a970-3b80-4cbe-a4f4-8bc523030ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:52.156617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55a970-3b80-4cbe-a4f4-8bc523030ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:52.157318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55a970-3b80-4cbe-a4f4-8bc523030ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:52.163299 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55a970-3b80-4cbe-a4f4-8bc523030ec5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:52.169027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1258/2511] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:06:52.174011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63478bf9-3f40-4e16-a076-5a09d9400326 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:52.184628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63478bf9-3f40-4e16-a076-5a09d9400326 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:52.189588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7654a-43ed-4bd4-96a0-bf57bca70bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:52.190241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7654a-43ed-4bd4-96a0-bf57bca70bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:52.190529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7654a-43ed-4bd4-96a0-bf57bca70bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:52.190804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7654a-43ed-4bd4-96a0-bf57bca70bb2 admin admin] PATH_INFO: `/v3/projects/040a8aa829934eb980cf93c7ef64bf2e/users/06421ee0e8e948ed85c4c8a19b113a4e/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:52.192826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7654a-43ed-4bd4-96a0-bf57bca70bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040a8aa829934eb980cf93c7ef64bf2e, user_id=06421ee0e8e948ed85c4c8a19b113a4e, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:52.195583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7654a-43ed-4bd4-96a0-bf57bca70bb2 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:52.206473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1254/2512] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:06:52 2022] PUT /identity/v3/projects/040a8aa829934eb980cf93c7ef64bf2e/users/06421ee0e8e948ed85c4c8a19b113a4e/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:06:52.216834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021d48-7348-4248-ab7f-01d7561c2043 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:52.217125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021d48-7348-4248-ab7f-01d7561c2043 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:52.217402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021d48-7348-4248-ab7f-01d7561c2043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:52.248019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6f021d48-7348-4248-ab7f-01d7561c2043 None None] MFA Rules not processed for user `06421ee0e8e948ed85c4c8a19b113a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:06:52.249273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6f021d48-7348-4248-ab7f-01d7561c2043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:52.320153 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1259/2513] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:06:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:06:52.332577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7654a-43ed-4bd4-96a0-bf57bca70bb2 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:52.334267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-13a7654a-43ed-4bd4-96a0-bf57bca70bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:52.400111 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7654a-43ed-4bd4-96a0-bf57bca70bb2 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:52.408696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e71955-55c1-4bfa-9804-de0a099f5f78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:52.408696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e71955-55c1-4bfa-9804-de0a099f5f78 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:52.408696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e71955-55c1-4bfa-9804-de0a099f5f78 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:52.408696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e71955-55c1-4bfa-9804-de0a099f5f78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:52.469214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e71955-55c1-4bfa-9804-de0a099f5f78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:52.470697 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e71955-55c1-4bfa-9804-de0a099f5f78 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:52.480273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1255/2514] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:54.549555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f021d48-7348-4248-ab7f-01d7561c2043 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:54.550946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6f021d48-7348-4248-ab7f-01d7561c2043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:54.563416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f021d48-7348-4248-ab7f-01d7561c2043 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:54.566985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c863296-22fb-4ae2-8307-89180bd3d59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:54.567682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c863296-22fb-4ae2-8307-89180bd3d59a service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:54.567954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c863296-22fb-4ae2-8307-89180bd3d59a service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:54.568212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c863296-22fb-4ae2-8307-89180bd3d59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:54.613375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:54.625761 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c863296-22fb-4ae2-8307-89180bd3d59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:54.627213 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c863296-22fb-4ae2-8307-89180bd3d59a service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:54.636511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1260/2515] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:55.500073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e71955-55c1-4bfa-9804-de0a099f5f78 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:55.501725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c6e71955-55c1-4bfa-9804-de0a099f5f78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:55.519124 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:06:55.565294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e71955-55c1-4bfa-9804-de0a099f5f78 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:55.569053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:55.569658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:55.569941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:55.570246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:55.572141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:55.645148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:55.646540 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:55.656583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1256/2516] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:56.127472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c863296-22fb-4ae2-8307-89180bd3d59a service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:56.136220 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c863296-22fb-4ae2-8307-89180bd3d59a service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:56.140602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f0503-573b-492a-98ae-558a83f9a080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:56.141269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f0503-573b-492a-98ae-558a83f9a080 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:56.141550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f0503-573b-492a-98ae-558a83f9a080 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:56.141826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f0503-573b-492a-98ae-558a83f9a080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:56.152026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f0503-573b-492a-98ae-558a83f9a080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:56.153472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f0503-573b-492a-98ae-558a83f9a080 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:56.164553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1261/2517] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:06:59.240629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:06:59.242023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:59.378043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960b5a8-3d30-40fa-bea5-02ef8953f891 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:06:59.383641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a471f64-5dff-4a7f-bf0a-9439cca0c756 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:06:59.384474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a471f64-5dff-4a7f-bf0a-9439cca0c756 service placement] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:06:59.384928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a471f64-5dff-4a7f-bf0a-9439cca0c756 service placement] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:06:59.385381 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a471f64-5dff-4a7f-bf0a-9439cca0c756 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:06:59.387678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5a471f64-5dff-4a7f-bf0a-9439cca0c756 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:06:59.402690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a471f64-5dff-4a7f-bf0a-9439cca0c756 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:06:59.404364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a471f64-5dff-4a7f-bf0a-9439cca0c756 service placement] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:06:59.416574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1257/2518] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:06:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:07:01.044595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f0503-573b-492a-98ae-558a83f9a080 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:01.108094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f0503-573b-492a-98ae-558a83f9a080 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:01.114012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:01.114659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:01.114934 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:01.115201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] PATH_INFO: `/v3/users/0cff0da3c8334a94b3d8d97c4fecb730` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:01.116593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cff0da3c8334a94b3d8d97c4fecb730)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:01.118574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:01.379773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cff0da3c8334a94b3d8d97c4fecb730'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:01.380421 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cff0da3c8334a94b3d8d97c4fecb730'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:01.388223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cff0da3c8334a94b3d8d97c4fecb730'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:01.466195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cff0da3c8334a94b3d8d97c4fecb730'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:01.482476 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cff0da3c8334a94b3d8d97c4fecb730'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:01.489926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1262/2519] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:07:01 2022] DELETE /identity/v3/users/0cff0da3c8334a94b3d8d97c4fecb730 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:01.494787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5dfdd-d1bf-4c26-ab16-966456685ec1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:01.495284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5dfdd-d1bf-4c26-ab16-966456685ec1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:01.495423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5dfdd-d1bf-4c26-ab16-966456685ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:01.503754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:01.552722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d5a5dfdd-d1bf-4c26-ab16-966456685ec1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:01.555088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d5a5dfdd-d1bf-4c26-ab16-966456685ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:01.644495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1258/2520] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:07:01.656196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:01.659056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:01.780096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bce23-2c98-4c14-bf91-54720c19682f admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:01.784001 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd2e46-2af2-4608-9f18-c251d5a8a2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:01.784609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd2e46-2af2-4608-9f18-c251d5a8a2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:01.784884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd2e46-2af2-4608-9f18-c251d5a8a2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:01.785515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd2e46-2af2-4608-9f18-c251d5a8a2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:01.794672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd2e46-2af2-4608-9f18-c251d5a8a2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:01.796168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd2e46-2af2-4608-9f18-c251d5a8a2c5 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:01.805901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1263/2521] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:07:02.375245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5dfdd-d1bf-4c26-ab16-966456685ec1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:02.375245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d5a5dfdd-d1bf-4c26-ab16-966456685ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:02.386562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5dfdd-d1bf-4c26-ab16-966456685ec1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:02.393159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:02.393969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:02.394427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:02.394726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] PATH_INFO: `/v3/projects/6df5bae32578495fb58326a61e4c5fb6` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:02.396744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df5bae32578495fb58326a61e4c5fb6)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:02.401090 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:02.553442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df5bae32578495fb58326a61e4c5fb6', 'request_id': 'req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:02.560261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df5bae32578495fb58326a61e4c5fb6', 'request_id': 'req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:02.632655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df5bae32578495fb58326a61e4c5fb6', 'request_id': 'req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:02.644944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] The token cache is being invalidate because project 6df5bae32578495fb58326a61e4c5fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:07:02.645242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:02.645911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:02.647509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1259/2522] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:07:02 2022] DELETE /identity/v3/projects/6df5bae32578495fb58326a61e4c5fb6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:02.651489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd2e46-2af2-4608-9f18-c251d5a8a2c5 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:02.661592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd2e46-2af2-4608-9f18-c251d5a8a2c5 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:02.666477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:02.719675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:02.720312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:02.720527 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:02.720802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] PATH_INFO: `/v3/users/fa1b7d8d82c84c00bbf0a8532a40e0ed` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:02.721970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1b7d8d82c84c00bbf0a8532a40e0ed)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:02.723961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:02.955769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1b7d8d82c84c00bbf0a8532a40e0ed'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:02.957098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1b7d8d82c84c00bbf0a8532a40e0ed'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:02.966445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1b7d8d82c84c00bbf0a8532a40e0ed'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:03.081441 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1b7d8d82c84c00bbf0a8532a40e0ed'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:03.099515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1b7d8d82c84c00bbf0a8532a40e0ed'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:03.106577 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1264/2523] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:07:02 2022] DELETE /identity/v3/users/fa1b7d8d82c84c00bbf0a8532a40e0ed => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:03.588888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:03.591232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:03.613773 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ff8d4-5e8b-41d6-9f8c-8a6e42669500 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:03.645436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:03.646878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:03.695718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:03.696368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:03.696647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:03.697335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] PATH_INFO: `/v3/users/9984855ce18a4bf59e5eb91642ffc701` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:03.698081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9984855ce18a4bf59e5eb91642ffc701)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:03.700152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:03.717248 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:03.756845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b48dc-7414-4ff9-86f8-984cbd00c607 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:03.761994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:03.762637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:03.762923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:03.774136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] PATH_INFO: `/v3/projects/ed329f77b2f548f19a60f13ae5fdf37b` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:03.774136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed329f77b2f548f19a60f13ae5fdf37b)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:03.774136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:03.954905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:03.963869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9984855ce18a4bf59e5eb91642ffc701'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:03.964567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9984855ce18a4bf59e5eb91642ffc701'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:03.972100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed329f77b2f548f19a60f13ae5fdf37b', 'request_id': 'req-84043131-fce8-412d-b116-fb28ea14f791'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:03.979347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed329f77b2f548f19a60f13ae5fdf37b', 'request_id': 'req-84043131-fce8-412d-b116-fb28ea14f791'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:03.987430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed329f77b2f548f19a60f13ae5fdf37b', 'request_id': 'req-84043131-fce8-412d-b116-fb28ea14f791'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.066569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9984855ce18a4bf59e5eb91642ffc701'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.077826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9984855ce18a4bf59e5eb91642ffc701'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.096923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9984855ce18a4bf59e5eb91642ffc701'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.105873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1260/2524] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:07:03 2022] DELETE /identity/v3/users/9984855ce18a4bf59e5eb91642ffc701 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:04.171900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] The token cache is being invalidate because project ed329f77b2f548f19a60f13ae5fdf37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:07:04.172268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.172792 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.174318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1265/2525] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:07:03 2022] DELETE /identity/v3/projects/ed329f77b2f548f19a60f13ae5fdf37b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:04.178598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:04.180118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:04.261273 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c88ef-1928-4e18-8441-60c97f49e584 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:04.266819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:04.267544 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:04.267824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:04.268100 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] PATH_INFO: `/v3/users/06421ee0e8e948ed85c4c8a19b113a4e` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:04.269321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06421ee0e8e948ed85c4c8a19b113a4e)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:04.271342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:04.408440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:04.410142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:04.486374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84043131-fce8-412d-b116-fb28ea14f791 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:04.491356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:04.492003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:04.492282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:04.492553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] PATH_INFO: `/v3/projects/f11fb89ff0bb4c529bc9d523a3b58f63` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:04.493734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11fb89ff0bb4c529bc9d523a3b58f63)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:04.495916 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:04.513625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06421ee0e8e948ed85c4c8a19b113a4e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.515133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06421ee0e8e948ed85c4c8a19b113a4e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.597435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06421ee0e8e948ed85c4c8a19b113a4e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.607623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06421ee0e8e948ed85c4c8a19b113a4e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.622995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11fb89ff0bb4c529bc9d523a3b58f63', 'request_id': 'req-d927e58e-86e0-4ea1-a2f7-7f17542520c4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.625807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06421ee0e8e948ed85c4c8a19b113a4e'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.628098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11fb89ff0bb4c529bc9d523a3b58f63', 'request_id': 'req-d927e58e-86e0-4ea1-a2f7-7f17542520c4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.636443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1261/2526] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:07:04 2022] DELETE /identity/v3/users/06421ee0e8e948ed85c4c8a19b113a4e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:04.636581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11fb89ff0bb4c529bc9d523a3b58f63', 'request_id': 'req-d927e58e-86e0-4ea1-a2f7-7f17542520c4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.717760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] The token cache is being invalidate because project f11fb89ff0bb4c529bc9d523a3b58f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:07:04.717965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.718590 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:04.720372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1266/2527] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:07:04 2022] DELETE /identity/v3/projects/f11fb89ff0bb4c529bc9d523a3b58f63 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:07:04.724582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:04.725997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:04.796305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acab688-96dc-4e6e-9f16-2a30fed4db7e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:04.801247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:04.806169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:04.806169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:04.806169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] PATH_INFO: `/v3/users/d30f8697368e419f93695d75d338068c` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:04.806169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d30f8697368e419f93695d75d338068c)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:04.806169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:05.013979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:05.030445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd30f8697368e419f93695d75d338068c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.032298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd30f8697368e419f93695d75d338068c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.091378 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:05.097020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:05.118072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd30f8697368e419f93695d75d338068c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.132150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd30f8697368e419f93695d75d338068c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.145509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd30f8697368e419f93695d75d338068c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.152487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1262/2528] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:07:04 2022] DELETE /identity/v3/users/d30f8697368e419f93695d75d338068c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:07:05.168247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927e58e-86e0-4ea1-a2f7-7f17542520c4 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:05.236993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:05.237897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:05.238293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:05.238749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] PATH_INFO: `/v3/projects/040a8aa829934eb980cf93c7ef64bf2e` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:05.240787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:05.241919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040a8aa829934eb980cf93c7ef64bf2e)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:05.244180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:05.351129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040a8aa829934eb980cf93c7ef64bf2e', 'request_id': 'req-042de05f-aeef-449a-ba4d-808fe8c3cb97'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.357796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040a8aa829934eb980cf93c7ef64bf2e', 'request_id': 'req-042de05f-aeef-449a-ba4d-808fe8c3cb97'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.365107 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040a8aa829934eb980cf93c7ef64bf2e', 'request_id': 'req-042de05f-aeef-449a-ba4d-808fe8c3cb97'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.437925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] The token cache is being invalidate because project 040a8aa829934eb980cf93c7ef64bf2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:07:05.438188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.439149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-042de05f-aeef-449a-ba4d-808fe8c3cb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.439420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:05.443861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1267/2529] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:07:05 2022] DELETE /identity/v3/projects/040a8aa829934eb980cf93c7ef64bf2e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:07:05.444018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:05.453769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96c962-85b1-48f4-b582-88490c40b58c None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:05.454058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96c962-85b1-48f4-b582-88490c40b58c None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:05.454340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96c962-85b1-48f4-b582-88490c40b58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:05.460475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c61761-5727-485f-9f29-5831e9d9748d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:05.520864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-db96c962-85b1-48f4-b582-88490c40b58c None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:05.522934 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-db96c962-85b1-48f4-b582-88490c40b58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:05.537484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:05.537484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:05.537484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:05.537484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] PATH_INFO: `/v3/projects/909ab90fbc40431c947b826f06de39b7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:05.538032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=909ab90fbc40431c947b826f06de39b7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:05.538032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:05.543040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1268/2530] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:07:05.552118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac91e64-1d31-4e6c-b523-b62a78d65940 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:05.552398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac91e64-1d31-4e6c-b523-b62a78d65940 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:05.552673 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac91e64-1d31-4e6c-b523-b62a78d65940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:05.580958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6ac91e64-1d31-4e6c-b523-b62a78d65940 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:05.582434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6ac91e64-1d31-4e6c-b523-b62a78d65940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:05.590498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1269/2531] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:07:05.595444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac91e64-1d31-4e6c-b523-b62a78d65940 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:05.605252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac91e64-1d31-4e6c-b523-b62a78d65940 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:05.610781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828de6a-0007-4239-a417-b1a4dfb1703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:05.611412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828de6a-0007-4239-a417-b1a4dfb1703a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:05.611679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828de6a-0007-4239-a417-b1a4dfb1703a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:05.611952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828de6a-0007-4239-a417-b1a4dfb1703a admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:05.612596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828de6a-0007-4239-a417-b1a4dfb1703a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:07:05.612969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828de6a-0007-4239-a417-b1a4dfb1703a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:05.614572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828de6a-0007-4239-a417-b1a4dfb1703a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:05.630641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1270/2532] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:07:05.632708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828de6a-0007-4239-a417-b1a4dfb1703a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:05.643778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828de6a-0007-4239-a417-b1a4dfb1703a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:05.647046 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909ab90fbc40431c947b826f06de39b7', 'request_id': 'req-9bf8cc5c-44f6-4963-adcc-2b271a322d34'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.655814 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909ab90fbc40431c947b826f06de39b7', 'request_id': 'req-9bf8cc5c-44f6-4963-adcc-2b271a322d34'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.692597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:05.711866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c3ef5-e9b0-4f42-abcb-167c7fdb12f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:05.712629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c3ef5-e9b0-4f42-abcb-167c7fdb12f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:05.713008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c3ef5-e9b0-4f42-abcb-167c7fdb12f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:05.713381 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c3ef5-e9b0-4f42-abcb-167c7fdb12f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:05.714140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c3ef5-e9b0-4f42-abcb-167c7fdb12f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:05.716224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c3ef5-e9b0-4f42-abcb-167c7fdb12f6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:05.719004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909ab90fbc40431c947b826f06de39b7', 'request_id': 'req-9bf8cc5c-44f6-4963-adcc-2b271a322d34'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.732347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] The token cache is being invalidate because project 909ab90fbc40431c947b826f06de39b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:07:05.732836 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.734414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:05.736112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1263/2533] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:07:05 2022] DELETE /identity/v3/projects/909ab90fbc40431c947b826f06de39b7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:05.787471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:05.823461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1271/2534] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:07:05 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:07:05.828492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:05.830976 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:05.847171 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8cc5c-44f6-4963-adcc-2b271a322d34 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:05.919089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552abca-e348-4d6b-86db-43c5bcbb298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:05.919783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552abca-e348-4d6b-86db-43c5bcbb298d admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:05.920063 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552abca-e348-4d6b-86db-43c5bcbb298d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:05.920336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552abca-e348-4d6b-86db-43c5bcbb298d admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:05.921657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552abca-e348-4d6b-86db-43c5bcbb298d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:05.923789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552abca-e348-4d6b-86db-43c5bcbb298d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:06.033121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1264/2535] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:07:05 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:07:06.037498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c3ef5-e9b0-4f42-abcb-167c7fdb12f6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:06.048752 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c3ef5-e9b0-4f42-abcb-167c7fdb12f6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:06.053691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047cb39-cd16-48ca-ab26-5a96dd492dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:06.054361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047cb39-cd16-48ca-ab26-5a96dd492dca admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:06.054663 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047cb39-cd16-48ca-ab26-5a96dd492dca admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:06.054929 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047cb39-cd16-48ca-ab26-5a96dd492dca admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:06.055601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047cb39-cd16-48ca-ab26-5a96dd492dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:06.057293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047cb39-cd16-48ca-ab26-5a96dd492dca admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:06.069175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1272/2536] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:07:06.073367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552abca-e348-4d6b-86db-43c5bcbb298d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:06.085070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552abca-e348-4d6b-86db-43c5bcbb298d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:06.094561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea515ee3-1094-42b4-98ac-32912254d02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:06.095163 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea515ee3-1094-42b4-98ac-32912254d02a admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:06.095505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea515ee3-1094-42b4-98ac-32912254d02a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:06.095774 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea515ee3-1094-42b4-98ac-32912254d02a admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:06.096422 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea515ee3-1094-42b4-98ac-32912254d02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:06.098029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea515ee3-1094-42b4-98ac-32912254d02a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:06.109641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1265/2537] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:07:06.115576 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047cb39-cd16-48ca-ab26-5a96dd492dca admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:06.127776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047cb39-cd16-48ca-ab26-5a96dd492dca admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:06.132541 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a0d7a-38bc-4d50-ab39-a51b45b8c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:06.133210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0d7a-38bc-4d50-ab39-a51b45b8c129 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:06.133499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0d7a-38bc-4d50-ab39-a51b45b8c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:06.133768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0d7a-38bc-4d50-ab39-a51b45b8c129 admin admin] PATH_INFO: `/v3/projects/4b657aad0d3646f9aa0341dd0f46b034/users/0504e9236074460981fd21d5b32f0dda/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:06.150450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a0d7a-38bc-4d50-ab39-a51b45b8c129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b657aad0d3646f9aa0341dd0f46b034, user_id=0504e9236074460981fd21d5b32f0dda, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:06.153194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a0d7a-38bc-4d50-ab39-a51b45b8c129 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:06.227412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1273/2538] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:07:06 2022] PUT /identity/v3/projects/4b657aad0d3646f9aa0341dd0f46b034/users/0504e9236074460981fd21d5b32f0dda/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:06.239579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf9ef2-889a-4820-a482-3242d2d6abe4 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:06.239867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf9ef2-889a-4820-a482-3242d2d6abe4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:06.240141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf9ef2-889a-4820-a482-3242d2d6abe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:06.269818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-dccf9ef2-889a-4820-a482-3242d2d6abe4 None None] MFA Rules not processed for user `0504e9236074460981fd21d5b32f0dda`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:06.271432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dccf9ef2-889a-4820-a482-3242d2d6abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:06.338372 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1266/2539] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:07:06.350679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a0d7a-38bc-4d50-ab39-a51b45b8c129 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:06.352711 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-261a0d7a-38bc-4d50-ab39-a51b45b8c129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:06.425545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a0d7a-38bc-4d50-ab39-a51b45b8c129 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:06.429301 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503206-b3ae-4946-88d3-13c4584d4cf7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4414630bb2da4523906f0b2dee0c4c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:06.429918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503206-b3ae-4946-88d3-13c4584d4cf7 service glance] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:06.430195 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503206-b3ae-4946-88d3-13c4584d4cf7 service glance] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:06.430457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503206-b3ae-4946-88d3-13c4584d4cf7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:06.440329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25503206-b3ae-4946-88d3-13c4584d4cf7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:06.441808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25503206-b3ae-4946-88d3-13c4584d4cf7 service glance] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:06.451374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1274/2540] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:07:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:07:08.744581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf9ef2-889a-4820-a482-3242d2d6abe4 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:08.745980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dccf9ef2-889a-4820-a482-3242d2d6abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:08.781007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:08.845861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf9ef2-889a-4820-a482-3242d2d6abe4 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:08.852420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:08.853123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:08.853400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:08.853673 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:08.855587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:08.870506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:08.873450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:08.885654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1267/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:07:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:07:16.447019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=58,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:18.914406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=29 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:21.908998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bf127-d467-494d-af47-ccdc405f3c38 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:21.909566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bf127-d467-494d-af47-ccdc405f3c38 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:21.909566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bf127-d467-494d-af47-ccdc405f3c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:21.944770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-822bf127-d467-494d-af47-ccdc405f3c38 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:21.945988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-822bf127-d467-494d-af47-ccdc405f3c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:22.020511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1275/2542] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 20:07:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:07:22.169893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:22.172177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:22.264608 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b1fc6-230b-40bc-9de8-b4cd3d6c722d service placement] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:22.269949 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf430e-f4fc-4220-9401-6f384352b953 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:22.270569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf430e-f4fc-4220-9401-6f384352b953 service swift] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:22.270852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf430e-f4fc-4220-9401-6f384352b953 service swift] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:22.271128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf430e-f4fc-4220-9401-6f384352b953 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:22.280382 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf430e-f4fc-4220-9401-6f384352b953 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:22.281971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf430e-f4fc-4220-9401-6f384352b953 service swift] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:22.290279 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1268/2543] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:07:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:07:23.202604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb858-4179-446b-a30a-73144a50f629 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:23.203148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb858-4179-446b-a30a-73144a50f629 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:23.203390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb858-4179-446b-a30a-73144a50f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:23.227367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b2aeb858-4179-446b-a30a-73144a50f629 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:23.228433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b2aeb858-4179-446b-a30a-73144a50f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:23.236645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1276/2544] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 20:07:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:07:23.256374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf430e-f4fc-4220-9401-6f384352b953 service swift] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:23.268147 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf430e-f4fc-4220-9401-6f384352b953 service swift] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:23.274895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833ec1-6431-43af-82fc-9a53b7c8e468 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:23.275664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833ec1-6431-43af-82fc-9a53b7c8e468 service swift] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:23.275987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833ec1-6431-43af-82fc-9a53b7c8e468 service swift] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:23.276269 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833ec1-6431-43af-82fc-9a53b7c8e468 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:23.293555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4833ec1-6431-43af-82fc-9a53b7c8e468 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:23.297416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4833ec1-6431-43af-82fc-9a53b7c8e468 service swift] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:23.307992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1269/2545] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:07:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:07:33.224751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=35 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:33.303696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=38 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:35.240771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeb858-4179-446b-a30a-73144a50f629 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:35.242455 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b2aeb858-4179-446b-a30a-73144a50f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:35.335454 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeb858-4179-446b-a30a-73144a50f629 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:35.341101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:35.341767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:35.342042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:35.342318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] PATH_INFO: `/v3/users/76086be41497482d9dc8eb770c272506` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:35.344214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76086be41497482d9dc8eb770c272506)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:35.346221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:35.502463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76086be41497482d9dc8eb770c272506'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:35.503267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76086be41497482d9dc8eb770c272506'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:35.512706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76086be41497482d9dc8eb770c272506'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:35.595344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76086be41497482d9dc8eb770c272506'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:35.614368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76086be41497482d9dc8eb770c272506'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:35.622209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1277/2546] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:07:35 2022] DELETE /identity/v3/users/76086be41497482d9dc8eb770c272506 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:36.005644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833ec1-6431-43af-82fc-9a53b7c8e468 service swift] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:36.024274 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833ec1-6431-43af-82fc-9a53b7c8e468 service swift] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:36.122812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:36.123647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:36.123976 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:36.124252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] PATH_INFO: `/v3/projects/095b6f14ca054b848d8f1164519af641` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:36.125945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=095b6f14ca054b848d8f1164519af641)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:36.128003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:36.303955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095b6f14ca054b848d8f1164519af641', 'request_id': 'req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:36.313107 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095b6f14ca054b848d8f1164519af641', 'request_id': 'req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:36.971368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095b6f14ca054b848d8f1164519af641', 'request_id': 'req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:36.989157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] The token cache is being invalidate because project 095b6f14ca054b848d8f1164519af641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:07:36.989450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:36.990211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:36.992651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1270/2547] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:07:36 2022] DELETE /identity/v3/projects/095b6f14ca054b848d8f1164519af641 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:36.997357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:37.000109 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:37.014209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4c849-e13d-4b59-822a-198ed2096d26 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:37.090304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:37.090969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:37.091272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:37.091705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] PATH_INFO: `/v3/users/5a2f702bc4c6443299581ced6f925c07` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:37.093953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2f702bc4c6443299581ced6f925c07)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:37.096618 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:37.130837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:37.431094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2f702bc4c6443299581ced6f925c07'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:37.432894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2f702bc4c6443299581ced6f925c07'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:37.446314 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2f702bc4c6443299581ced6f925c07'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:37.585793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2f702bc4c6443299581ced6f925c07'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:37.604356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2f702bc4c6443299581ced6f925c07'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:37.616952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1278/2548] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:07:36 2022] DELETE /identity/v3/users/5a2f702bc4c6443299581ced6f925c07 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:37.629347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:37.630876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:37.759910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2a1ae-30fb-4a32-a769-4dd6cbe662c4 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:37.790224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:37.816750 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:37.817416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:37.817693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:37.817971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:37.819893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:37.890599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:37.892021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:37.902804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1271/2549] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:07:38.432915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:38.434480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:38.448817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98142e6-b708-4b90-86c6-e33dc6020d8a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:38.454617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:38.455284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:38.457715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:38.457715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] PATH_INFO: `/v3/projects/f3b54b0fedcb48eb80c2eed690540e7c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:38.457715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b54b0fedcb48eb80c2eed690540e7c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:38.458948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:38.583286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b54b0fedcb48eb80c2eed690540e7c', 'request_id': 'req-4ead2681-121b-4b0f-a901-79950131d2c7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:38.589783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b54b0fedcb48eb80c2eed690540e7c', 'request_id': 'req-4ead2681-121b-4b0f-a901-79950131d2c7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:38.596448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b54b0fedcb48eb80c2eed690540e7c', 'request_id': 'req-4ead2681-121b-4b0f-a901-79950131d2c7'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:38.659178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] The token cache is being invalidate because project f3b54b0fedcb48eb80c2eed690540e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:07:38.659503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:38.660239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4ead2681-121b-4b0f-a901-79950131d2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:38.661981 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1279/2550] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:07:38 2022] DELETE /identity/v3/projects/f3b54b0fedcb48eb80c2eed690540e7c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:07:44.947086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:44.948556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:44.961184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc46b7-a8ae-4862-8428-d366bf610d04 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:45.026135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:45.026776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:45.027078 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:45.027379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] PATH_INFO: `/v3/users/0504e9236074460981fd21d5b32f0dda` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:45.028575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0504e9236074460981fd21d5b32f0dda)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:45.030578 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:45.232932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0504e9236074460981fd21d5b32f0dda'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:45.233724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0504e9236074460981fd21d5b32f0dda'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:45.373888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0504e9236074460981fd21d5b32f0dda'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:45.383006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0504e9236074460981fd21d5b32f0dda'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:45.407292 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:45.409222 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0504e9236074460981fd21d5b32f0dda'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:45.416131 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1272/2551] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:07:44 2022] DELETE /identity/v3/users/0504e9236074460981fd21d5b32f0dda => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:45.420666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fc56-ad5b-49fa-ab40-b1ba693cce9a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:45.421175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fc56-ad5b-49fa-ab40-b1ba693cce9a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:45.421284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fc56-ad5b-49fa-ab40-b1ba693cce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:45.441040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8496fc56-ad5b-49fa-ab40-b1ba693cce9a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:45.442357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8496fc56-ad5b-49fa-ab40-b1ba693cce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:45.510119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1280/2552] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:07:45.520211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:45.521797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:45.584558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdf627-9b1e-49f8-83c7-7498698e4b7b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:45.588285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46201fe6-e4dc-4033-8f74-e40134ec32de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:45.588907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46201fe6-e4dc-4033-8f74-e40134ec32de service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:45.589192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46201fe6-e4dc-4033-8f74-e40134ec32de service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:45.589469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46201fe6-e4dc-4033-8f74-e40134ec32de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:45.599155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46201fe6-e4dc-4033-8f74-e40134ec32de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:45.600769 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46201fe6-e4dc-4033-8f74-e40134ec32de service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:45.612123 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1273/2553] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:07:46.097128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fc56-ad5b-49fa-ab40-b1ba693cce9a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:46.097714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8496fc56-ad5b-49fa-ab40-b1ba693cce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:46.112263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fc56-ad5b-49fa-ab40-b1ba693cce9a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:46.117053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:46.117703 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:46.117985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:46.118261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] PATH_INFO: `/v3/projects/4b657aad0d3646f9aa0341dd0f46b034` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:46.119470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b657aad0d3646f9aa0341dd0f46b034)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:46.121432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:46.140053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:46.255050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b657aad0d3646f9aa0341dd0f46b034', 'request_id': 'req-f112068b-4bb2-4885-a040-b0aee9fc1b3b'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:46.261324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b657aad0d3646f9aa0341dd0f46b034', 'request_id': 'req-f112068b-4bb2-4885-a040-b0aee9fc1b3b'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:46.268867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b657aad0d3646f9aa0341dd0f46b034', 'request_id': 'req-f112068b-4bb2-4885-a040-b0aee9fc1b3b'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:46.365689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] The token cache is being invalidate because project 4b657aad0d3646f9aa0341dd0f46b034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:07:46.365915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:46.366532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-f112068b-4bb2-4885-a040-b0aee9fc1b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:46.368318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1281/2554] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:07:46 2022] DELETE /identity/v3/projects/4b657aad0d3646f9aa0341dd0f46b034 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:46.373383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f354-83de-4b3a-9044-9d6130f0061d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:46.375794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f354-83de-4b3a-9044-9d6130f0061d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:46.375794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f354-83de-4b3a-9044-9d6130f0061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:46.397816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b1c1f354-83de-4b3a-9044-9d6130f0061d None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:46.399109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b1c1f354-83de-4b3a-9044-9d6130f0061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:46.478119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1274/2555] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:07:46.544457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afd6d0-5dcf-490b-a772-d8ff175bde91 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:46.545062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afd6d0-5dcf-490b-a772-d8ff175bde91 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:46.545062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afd6d0-5dcf-490b-a772-d8ff175bde91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:46.567478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-86afd6d0-5dcf-490b-a772-d8ff175bde91 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:46.567950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-86afd6d0-5dcf-490b-a772-d8ff175bde91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:46.585225 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1282/2556] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:07:46.585703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1f354-83de-4b3a-9044-9d6130f0061d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:46.596197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1f354-83de-4b3a-9044-9d6130f0061d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:46.601047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916afedc-61ff-4671-9d14-fc4d60fcb052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:46.601660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916afedc-61ff-4671-9d14-fc4d60fcb052 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:46.601937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916afedc-61ff-4671-9d14-fc4d60fcb052 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:46.602210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916afedc-61ff-4671-9d14-fc4d60fcb052 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:46.602869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916afedc-61ff-4671-9d14-fc4d60fcb052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:07:46.603168 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916afedc-61ff-4671-9d14-fc4d60fcb052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:46.604856 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916afedc-61ff-4671-9d14-fc4d60fcb052 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:46.620974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1275/2557] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:07:46.625722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afd6d0-5dcf-490b-a772-d8ff175bde91 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:46.635701 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afd6d0-5dcf-490b-a772-d8ff175bde91 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:46.642098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938311f2-901d-4e3b-a614-deed65468187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:46.642664 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938311f2-901d-4e3b-a614-deed65468187 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:46.642954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938311f2-901d-4e3b-a614-deed65468187 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:46.643254 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938311f2-901d-4e3b-a614-deed65468187 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:46.643983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938311f2-901d-4e3b-a614-deed65468187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:46.646004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938311f2-901d-4e3b-a614-deed65468187 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:46.756815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1283/2558] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:07:46 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:07:46.758550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916afedc-61ff-4671-9d14-fc4d60fcb052 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:46.769057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916afedc-61ff-4671-9d14-fc4d60fcb052 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:46.830372 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2deab4-36bf-406b-a611-2d4db3a4f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:46.830991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2deab4-36bf-406b-a611-2d4db3a4f14f admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:46.831294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2deab4-36bf-406b-a611-2d4db3a4f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:46.831570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2deab4-36bf-406b-a611-2d4db3a4f14f admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:46.832206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2deab4-36bf-406b-a611-2d4db3a4f14f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:46.834148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2deab4-36bf-406b-a611-2d4db3a4f14f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:46.948471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1276/2559] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:07:46 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:07:46.952758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938311f2-901d-4e3b-a614-deed65468187 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:46.964767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938311f2-901d-4e3b-a614-deed65468187 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:46.970391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad40b-32c1-4e1b-8399-c6e52768ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:46.971007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad40b-32c1-4e1b-8399-c6e52768ee11 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:46.971316 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad40b-32c1-4e1b-8399-c6e52768ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:46.971589 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad40b-32c1-4e1b-8399-c6e52768ee11 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:46.972260 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad40b-32c1-4e1b-8399-c6e52768ee11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:46.973864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad40b-32c1-4e1b-8399-c6e52768ee11 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:46.985490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1284/2560] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:07:46.989834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2deab4-36bf-406b-a611-2d4db3a4f14f admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:47.000417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2deab4-36bf-406b-a611-2d4db3a4f14f admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:47.005191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d01baa-9453-4054-9ec8-9f8c362a1d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:47.005801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d01baa-9453-4054-9ec8-9f8c362a1d10 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:47.006079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d01baa-9453-4054-9ec8-9f8c362a1d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:47.006351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d01baa-9453-4054-9ec8-9f8c362a1d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:47.006994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d01baa-9453-4054-9ec8-9f8c362a1d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:47.008634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d01baa-9453-4054-9ec8-9f8c362a1d10 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:47.020979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1277/2561] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:07:47.025463 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad40b-32c1-4e1b-8399-c6e52768ee11 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:47.036778 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad40b-32c1-4e1b-8399-c6e52768ee11 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:47.041604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab94d9-a018-4b5a-9cfe-73f1d6503f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:47.042291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab94d9-a018-4b5a-9cfe-73f1d6503f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:47.042552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab94d9-a018-4b5a-9cfe-73f1d6503f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:47.042829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab94d9-a018-4b5a-9cfe-73f1d6503f01 admin admin] PATH_INFO: `/v3/projects/4614cc0015834c7aa959abfa9e106a78/users/edaa9b35106240e9b8a7905ac214ccbd/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:47.064397 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab94d9-a018-4b5a-9cfe-73f1d6503f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4614cc0015834c7aa959abfa9e106a78, user_id=edaa9b35106240e9b8a7905ac214ccbd, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:47.067119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab94d9-a018-4b5a-9cfe-73f1d6503f01 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:47.131734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1285/2562] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:07:47 2022] PUT /identity/v3/projects/4614cc0015834c7aa959abfa9e106a78/users/edaa9b35106240e9b8a7905ac214ccbd/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:47.142337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145b0b9-05c2-4f90-b086-411197023f99 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:47.142620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145b0b9-05c2-4f90-b086-411197023f99 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:47.142892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145b0b9-05c2-4f90-b086-411197023f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:47.151205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:47.174483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-5145b0b9-05c2-4f90-b086-411197023f99 None None] MFA Rules not processed for user `edaa9b35106240e9b8a7905ac214ccbd`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:47.175928 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5145b0b9-05c2-4f90-b086-411197023f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:47.246442 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1278/2563] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:07:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:07:47.258998 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab94d9-a018-4b5a-9cfe-73f1d6503f01 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:47.260826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0bab94d9-a018-4b5a-9cfe-73f1d6503f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:47.350848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab94d9-a018-4b5a-9cfe-73f1d6503f01 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:47.354860 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d5c43-71b0-414a-8e28-23439b09402c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:47.355491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d5c43-71b0-414a-8e28-23439b09402c service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:47.355777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d5c43-71b0-414a-8e28-23439b09402c service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:47.356057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d5c43-71b0-414a-8e28-23439b09402c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:47.376496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d5c43-71b0-414a-8e28-23439b09402c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:47.377991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d5c43-71b0-414a-8e28-23439b09402c service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:47.387720 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1286/2564] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:07:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:07:51.983191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36cb68-edc0-4037-a242-3f3189af5aa1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:51.983741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36cb68-edc0-4037-a242-3f3189af5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:51.983852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36cb68-edc0-4037-a242-3f3189af5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:52.004510 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-bb36cb68-edc0-4037-a242-3f3189af5aa1 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:52.005745 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bb36cb68-edc0-4037-a242-3f3189af5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:52.063539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1279/2565] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 20:07:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:07:52.075713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d5c43-71b0-414a-8e28-23439b09402c service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:52.077192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-282d5c43-71b0-414a-8e28-23439b09402c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:07:52.109074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:52.155148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d5c43-71b0-414a-8e28-23439b09402c service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:52.161049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372faf9f-2fc0-4f4e-9512-c2cb177633d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:52.161669 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372faf9f-2fc0-4f4e-9512-c2cb177633d2 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:52.161950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372faf9f-2fc0-4f4e-9512-c2cb177633d2 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:52.162224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372faf9f-2fc0-4f4e-9512-c2cb177633d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:52.172370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372faf9f-2fc0-4f4e-9512-c2cb177633d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:52.174632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372faf9f-2fc0-4f4e-9512-c2cb177633d2 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:52.183531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1287/2566] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:07:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:07:59.547393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36cb68-edc0-4037-a242-3f3189af5aa1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:07:59.636638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36cb68-edc0-4037-a242-3f3189af5aa1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:07:59.643209 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:07:59.644053 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:59.644418 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:59.644799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] PATH_INFO: `/v3/users/edaa9b35106240e9b8a7905ac214ccbd` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:59.646073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edaa9b35106240e9b8a7905ac214ccbd)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:07:59.648225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:07:59.821233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:07:59.828401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edaa9b35106240e9b8a7905ac214ccbd'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:59.828401 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edaa9b35106240e9b8a7905ac214ccbd'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:59.893944 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edaa9b35106240e9b8a7905ac214ccbd'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:59.904074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edaa9b35106240e9b8a7905ac214ccbd'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:59.919756 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edaa9b35106240e9b8a7905ac214ccbd'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:07:59.933569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1280/2567] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:07:59 2022] DELETE /identity/v3/users/edaa9b35106240e9b8a7905ac214ccbd => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:07:59.936646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ab56b-40cc-4bd6-9691-55a2c73d3789 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:07:59.938758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ab56b-40cc-4bd6-9691-55a2c73d3789 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:07:59.939875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ab56b-40cc-4bd6-9691-55a2c73d3789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:07:59.975016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7e2ab56b-40cc-4bd6-9691-55a2c73d3789 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:07:59.976375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7e2ab56b-40cc-4bd6-9691-55a2c73d3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:00.063553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1288/2568] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:00.087473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:00.093967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:00.210726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1084e6-68b7-43d1-916a-2bc73dd12bd3 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:00.214495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791a246-cc23-4112-84c6-9f9a5b6b323e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:00.215155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a246-cc23-4112-84c6-9f9a5b6b323e service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:00.215509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a246-cc23-4112-84c6-9f9a5b6b323e service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:00.215784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a246-cc23-4112-84c6-9f9a5b6b323e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:00.227903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791a246-cc23-4112-84c6-9f9a5b6b323e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:00.229400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791a246-cc23-4112-84c6-9f9a5b6b323e service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:00.240732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1281/2569] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:08:00.730074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ab56b-40cc-4bd6-9691-55a2c73d3789 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:00.732194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7e2ab56b-40cc-4bd6-9691-55a2c73d3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:00.746520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ab56b-40cc-4bd6-9691-55a2c73d3789 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:00.752614 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:00.753149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:00.753499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:00.753845 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] PATH_INFO: `/v3/projects/4614cc0015834c7aa959abfa9e106a78` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:00.755395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4614cc0015834c7aa959abfa9e106a78)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:00.757445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:00.888482 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4614cc0015834c7aa959abfa9e106a78', 'request_id': 'req-08a31308-a82b-4efd-9b81-c5cebed489d5'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:00.905267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4614cc0015834c7aa959abfa9e106a78', 'request_id': 'req-08a31308-a82b-4efd-9b81-c5cebed489d5'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:00.921266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4614cc0015834c7aa959abfa9e106a78', 'request_id': 'req-08a31308-a82b-4efd-9b81-c5cebed489d5'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:01.014209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] The token cache is being invalidate because project 4614cc0015834c7aa959abfa9e106a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:08:01.014905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:01.015166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:01.018654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1289/2570] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:08:00 2022] DELETE /identity/v3/projects/4614cc0015834c7aa959abfa9e106a78 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:10.235644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=40,keystone:DELETE=4,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:11.010279 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:12.453119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fb5fb-3e47-4a6b-9f6c-c71fb5696246 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:12.454275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fb5fb-3e47-4a6b-9f6c-c71fb5696246 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:12.454275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fb5fb-3e47-4a6b-9f6c-c71fb5696246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:12.474714 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-855fb5fb-3e47-4a6b-9f6c-c71fb5696246 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:12.475881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-855fb5fb-3e47-4a6b-9f6c-c71fb5696246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:12.532803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1282/2571] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 20:08:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:08:12.545033 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:12.546578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:12.622873 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a31308-a82b-4efd-9b81-c5cebed489d5 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:12.628183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c756-0953-4616-973d-4a994befe0c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:12.628900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c756-0953-4616-973d-4a994befe0c3 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:12.629103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c756-0953-4616-973d-4a994befe0c3 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:12.629382 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c756-0953-4616-973d-4a994befe0c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:12.639929 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8c756-0953-4616-973d-4a994befe0c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:12.643681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8c756-0953-4616-973d-4a994befe0c3 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:12.659946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1290/2572] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:08:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:08:22.524844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=25 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:22.652978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=32 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:30.902749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fb5fb-3e47-4a6b-9f6c-c71fb5696246 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:30.904556 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-855fb5fb-3e47-4a6b-9f6c-c71fb5696246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:30.962606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fb5fb-3e47-4a6b-9f6c-c71fb5696246 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:30.966328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f1d9e-dfde-4692-861c-f71810031031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:30.966931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f1d9e-dfde-4692-861c-f71810031031 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:30.967210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f1d9e-dfde-4692-861c-f71810031031 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:30.967531 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f1d9e-dfde-4692-861c-f71810031031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:30.970867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-043f1d9e-dfde-4692-861c-f71810031031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:31.036044 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f1d9e-dfde-4692-861c-f71810031031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:31.037482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f1d9e-dfde-4692-861c-f71810031031 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:31.047119 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1283/2573] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:08:34.611559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c756-0953-4616-973d-4a994befe0c3 service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:34.617265 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cdd8c756-0953-4616-973d-4a994befe0c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:34.628846 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c756-0953-4616-973d-4a994befe0c3 service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:34.633393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:34.634026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:34.634331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:34.634606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] PATH_INFO: `/v3/users/e395d0436d2443f5a6e55e137d375549` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:34.635768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e395d0436d2443f5a6e55e137d375549)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:34.637712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:34.852984 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e395d0436d2443f5a6e55e137d375549'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:34.853661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e395d0436d2443f5a6e55e137d375549'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:34.862070 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e395d0436d2443f5a6e55e137d375549'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:34.946908 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e395d0436d2443f5a6e55e137d375549'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:34.960434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3033f54e-8ffa-4820-b951-34d3a82d7dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e395d0436d2443f5a6e55e137d375549'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:34.966376 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1291/2574] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:08:34 2022] DELETE /identity/v3/users/e395d0436d2443f5a6e55e137d375549 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:35.197197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f1d9e-dfde-4692-861c-f71810031031 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:35.208742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f1d9e-dfde-4692-861c-f71810031031 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:35.268808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:35.269444 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:35.269726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:35.270001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] PATH_INFO: `/v3/projects/dd221bca74f74d9c8fe210a5c028e995` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:35.271128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd221bca74f74d9c8fe210a5c028e995)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:35.273079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:35.375130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd221bca74f74d9c8fe210a5c028e995', 'request_id': 'req-4118ab47-6fa8-45d2-a65d-237873e675a6'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:35.377572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:35.382175 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd221bca74f74d9c8fe210a5c028e995', 'request_id': 'req-4118ab47-6fa8-45d2-a65d-237873e675a6'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:35.458130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd221bca74f74d9c8fe210a5c028e995', 'request_id': 'req-4118ab47-6fa8-45d2-a65d-237873e675a6'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:35.469402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] The token cache is being invalidate because project dd221bca74f74d9c8fe210a5c028e995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:08:35.470103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:35.472909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4118ab47-6fa8-45d2-a65d-237873e675a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:35.473430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1284/2575] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:08:35 2022] DELETE /identity/v3/projects/dd221bca74f74d9c8fe210a5c028e995 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:35.478344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e003-7266-42d4-9556-24bae3cd6b63 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:35.478631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e003-7266-42d4-9556-24bae3cd6b63 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:35.478906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e003-7266-42d4-9556-24bae3cd6b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:35.499062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7f23e003-7266-42d4-9556-24bae3cd6b63 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:35.500331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7f23e003-7266-42d4-9556-24bae3cd6b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:35.559713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1292/2576] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:35.568364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ee9ed-c117-43b9-80c4-0a5814c935bb None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:35.568651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ee9ed-c117-43b9-80c4-0a5814c935bb None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:35.568927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ee9ed-c117-43b9-80c4-0a5814c935bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:35.588853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-2f7ee9ed-c117-43b9-80c4-0a5814c935bb None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:35.590059 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-2f7ee9ed-c117-43b9-80c4-0a5814c935bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:35.598327 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1285/2577] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:35.602851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e003-7266-42d4-9556-24bae3cd6b63 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:35.613115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e003-7266-42d4-9556-24bae3cd6b63 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:35.617690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a95b8-4121-433a-b05c-519fda87b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:35.618284 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a95b8-4121-433a-b05c-519fda87b4dd admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:35.618557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a95b8-4121-433a-b05c-519fda87b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:35.618825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a95b8-4121-433a-b05c-519fda87b4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:35.619501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a95b8-4121-433a-b05c-519fda87b4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:08:35.619800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a95b8-4121-433a-b05c-519fda87b4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:35.621391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a95b8-4121-433a-b05c-519fda87b4dd admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:35.634212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1293/2578] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:08:35.638366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ee9ed-c117-43b9-80c4-0a5814c935bb None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:35.648423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ee9ed-c117-43b9-80c4-0a5814c935bb None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:35.653078 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753efb1-8061-4682-9f35-ef041625c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:35.653678 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753efb1-8061-4682-9f35-ef041625c41d admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:35.653957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753efb1-8061-4682-9f35-ef041625c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:35.654226 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753efb1-8061-4682-9f35-ef041625c41d admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:35.654863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753efb1-8061-4682-9f35-ef041625c41d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:35.656890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753efb1-8061-4682-9f35-ef041625c41d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:35.737649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1286/2579] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:08:35 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:08:35.741922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a95b8-4121-433a-b05c-519fda87b4dd admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:35.752760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a95b8-4121-433a-b05c-519fda87b4dd admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:35.811390 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d3ff4-0efe-44ae-877d-f18c32e978d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:35.811991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d3ff4-0efe-44ae-877d-f18c32e978d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:35.812270 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d3ff4-0efe-44ae-877d-f18c32e978d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:35.812543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d3ff4-0efe-44ae-877d-f18c32e978d4 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:35.813174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d3ff4-0efe-44ae-877d-f18c32e978d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:35.815481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d3ff4-0efe-44ae-877d-f18c32e978d4 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:35.823312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:35.878169 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1294/2580] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:08:35 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:08:35.882564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753efb1-8061-4682-9f35-ef041625c41d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:35.893772 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753efb1-8061-4682-9f35-ef041625c41d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:35.898837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c26ea-1d5d-488f-a04f-5c8519c5e17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:35.899479 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c26ea-1d5d-488f-a04f-5c8519c5e17b admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:35.899754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c26ea-1d5d-488f-a04f-5c8519c5e17b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:35.900019 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c26ea-1d5d-488f-a04f-5c8519c5e17b admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:35.900754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c26ea-1d5d-488f-a04f-5c8519c5e17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:35.902355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c26ea-1d5d-488f-a04f-5c8519c5e17b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:35.913468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1287/2581] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:08:35.917487 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d3ff4-0efe-44ae-877d-f18c32e978d4 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:35.927983 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d3ff4-0efe-44ae-877d-f18c32e978d4 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:35.932813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f1994-1ba4-419b-b35c-7c3c53346855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:35.933419 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f1994-1ba4-419b-b35c-7c3c53346855 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:35.933699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f1994-1ba4-419b-b35c-7c3c53346855 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:35.933973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f1994-1ba4-419b-b35c-7c3c53346855 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:35.934652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f1994-1ba4-419b-b35c-7c3c53346855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:35.936293 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f1994-1ba4-419b-b35c-7c3c53346855 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:35.947138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1295/2582] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:08:35.951317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c26ea-1d5d-488f-a04f-5c8519c5e17b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:35.961873 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c26ea-1d5d-488f-a04f-5c8519c5e17b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:35.966485 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4252-0d55-46a6-bdfd-66d5159b6a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:35.967136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4252-0d55-46a6-bdfd-66d5159b6a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:35.967449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4252-0d55-46a6-bdfd-66d5159b6a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:35.967726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e4252-0d55-46a6-bdfd-66d5159b6a98 admin admin] PATH_INFO: `/v3/projects/536a12bd0bdf4034bccf5839fd3a4997/users/d90a4a61a8684362a261d1a510bf28d0/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:35.983443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e4252-0d55-46a6-bdfd-66d5159b6a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536a12bd0bdf4034bccf5839fd3a4997, user_id=d90a4a61a8684362a261d1a510bf28d0, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:35.986281 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e4252-0d55-46a6-bdfd-66d5159b6a98 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:36.055002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1288/2583] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:08:35 2022] PUT /identity/v3/projects/536a12bd0bdf4034bccf5839fd3a4997/users/d90a4a61a8684362a261d1a510bf28d0/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:36.063957 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807072e-40a2-4476-90e9-644142460ad9 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:36.064241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807072e-40a2-4476-90e9-644142460ad9 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:36.064644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807072e-40a2-4476-90e9-644142460ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:36.084175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-4807072e-40a2-4476-90e9-644142460ad9 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:36.085520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4807072e-40a2-4476-90e9-644142460ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:36.145662 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1296/2584] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:36.155478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4252-0d55-46a6-bdfd-66d5159b6a98 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:36.157470 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1e9e4252-0d55-46a6-bdfd-66d5159b6a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:36.214333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e4252-0d55-46a6-bdfd-66d5159b6a98 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:36.218017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f175f-a7a1-4cbf-af6f-e0171aa98435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:36.218621 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f175f-a7a1-4cbf-af6f-e0171aa98435 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:36.218900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f175f-a7a1-4cbf-af6f-e0171aa98435 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:36.219170 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f175f-a7a1-4cbf-af6f-e0171aa98435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:36.228969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f175f-a7a1-4cbf-af6f-e0171aa98435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:36.230402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f175f-a7a1-4cbf-af6f-e0171aa98435 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:36.240807 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1289/2585] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:08:37.466862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed815e-db06-4ce8-8bc4-c57fe361f61e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:37.473507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed815e-db06-4ce8-8bc4-c57fe361f61e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:37.473507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed815e-db06-4ce8-8bc4-c57fe361f61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:37.501504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ebed815e-db06-4ce8-8bc4-c57fe361f61e None None] MFA Rules not processed for user `d90a4a61a8684362a261d1a510bf28d0`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:37.502735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ebed815e-db06-4ce8-8bc4-c57fe361f61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:37.577215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1297/2586] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:08:37 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:37.582541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f175f-a7a1-4cbf-af6f-e0171aa98435 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:37.593174 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f175f-a7a1-4cbf-af6f-e0171aa98435 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:37.598766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f7149-f743-4bdf-af93-f69895be6556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:37.599532 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f7149-f743-4bdf-af93-f69895be6556 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:37.599810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f7149-f743-4bdf-af93-f69895be6556 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:37.600086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f7149-f743-4bdf-af93-f69895be6556 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:37.600716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f7149-f743-4bdf-af93-f69895be6556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:37.602645 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f7149-f743-4bdf-af93-f69895be6556 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:37.710078 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1290/2587] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:08:37 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:08:37.713470 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed815e-db06-4ce8-8bc4-c57fe361f61e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:37.724884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed815e-db06-4ce8-8bc4-c57fe361f61e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:37.781827 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546be4ab-09fa-4a98-8322-d1de34ffd9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:37.782626 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546be4ab-09fa-4a98-8322-d1de34ffd9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:37.782905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546be4ab-09fa-4a98-8322-d1de34ffd9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:37.783174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546be4ab-09fa-4a98-8322-d1de34ffd9d2 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:37.783830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546be4ab-09fa-4a98-8322-d1de34ffd9d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:37.785747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546be4ab-09fa-4a98-8322-d1de34ffd9d2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:37.881900 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:37.887920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1298/2588] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:08:37 2022] POST /identity/v3/users => generated 308 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:08:37.892565 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f7149-f743-4bdf-af93-f69895be6556 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:37.903162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f7149-f743-4bdf-af93-f69895be6556 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:37.907822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068d3b9-f599-4fd7-8758-b52211216e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:37.908417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068d3b9-f599-4fd7-8758-b52211216e4a admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:37.908692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068d3b9-f599-4fd7-8758-b52211216e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:37.908964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068d3b9-f599-4fd7-8758-b52211216e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:37.909606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068d3b9-f599-4fd7-8758-b52211216e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:37.911266 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068d3b9-f599-4fd7-8758-b52211216e4a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:37.921960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1291/2589] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:08:37.927086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546be4ab-09fa-4a98-8322-d1de34ffd9d2 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:37.937128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546be4ab-09fa-4a98-8322-d1de34ffd9d2 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:37.942698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1d1b8-0b64-4240-8f2f-2137502ce460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:37.943373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1d1b8-0b64-4240-8f2f-2137502ce460 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:37.943648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1d1b8-0b64-4240-8f2f-2137502ce460 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:37.943918 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1d1b8-0b64-4240-8f2f-2137502ce460 admin admin] PATH_INFO: `/v3/projects/24318381916f4eb991fc85569835900c/users/6c7ce830d8bf481bbd41380256b3454f/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:37.959294 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1d1b8-0b64-4240-8f2f-2137502ce460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24318381916f4eb991fc85569835900c, user_id=6c7ce830d8bf481bbd41380256b3454f, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:37.962031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1d1b8-0b64-4240-8f2f-2137502ce460 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:38.032683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1299/2590] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:08:37 2022] PUT /identity/v3/projects/24318381916f4eb991fc85569835900c/users/6c7ce830d8bf481bbd41380256b3454f/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:38.037162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068d3b9-f599-4fd7-8758-b52211216e4a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:38.047275 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068d3b9-f599-4fd7-8758-b52211216e4a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:38.092799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:38.106265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90123b2e-7579-49a3-bc85-6ce78f578019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:38.118602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90123b2e-7579-49a3-bc85-6ce78f578019 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:38.118602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90123b2e-7579-49a3-bc85-6ce78f578019 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:38.118602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90123b2e-7579-49a3-bc85-6ce78f578019 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:38.118602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90123b2e-7579-49a3-bc85-6ce78f578019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:38.118602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90123b2e-7579-49a3-bc85-6ce78f578019 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:38.120550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1292/2591] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:08:38.124897 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1d1b8-0b64-4240-8f2f-2137502ce460 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:38.140183 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1d1b8-0b64-4240-8f2f-2137502ce460 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:38.140575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b635a26-6d29-4c53-a140-1244e6c5010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:38.141216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b635a26-6d29-4c53-a140-1244e6c5010b admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:38.141519 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b635a26-6d29-4c53-a140-1244e6c5010b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:38.141789 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b635a26-6d29-4c53-a140-1244e6c5010b admin admin] PATH_INFO: `/v3/projects/24318381916f4eb991fc85569835900c/users/6c7ce830d8bf481bbd41380256b3454f/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:38.143726 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b635a26-6d29-4c53-a140-1244e6c5010b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24318381916f4eb991fc85569835900c, user_id=6c7ce830d8bf481bbd41380256b3454f, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:38.146371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b635a26-6d29-4c53-a140-1244e6c5010b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:38.156978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1300/2592] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:08:38 2022] PUT /identity/v3/projects/24318381916f4eb991fc85569835900c/users/6c7ce830d8bf481bbd41380256b3454f/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:39.394395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc245-bfdd-4d5b-9fc4-c4b27c0bbe84 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:39.395924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc245-bfdd-4d5b-9fc4-c4b27c0bbe84 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:39.395924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc245-bfdd-4d5b-9fc4-c4b27c0bbe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:39.427709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-bafcc245-bfdd-4d5b-9fc4-c4b27c0bbe84 None None] MFA Rules not processed for user `6c7ce830d8bf481bbd41380256b3454f`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:39.428952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bafcc245-bfdd-4d5b-9fc4-c4b27c0bbe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:39.508827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1293/2593] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:08:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:40.811065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b635a26-6d29-4c53-a140-1244e6c5010b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:40.878483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b635a26-6d29-4c53-a140-1244e6c5010b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:40.883117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:40.883775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:40.884042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:40.884308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] PATH_INFO: `/v3/users/d90a4a61a8684362a261d1a510bf28d0` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:40.885465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90a4a61a8684362a261d1a510bf28d0)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:40.887468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:41.060363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90a4a61a8684362a261d1a510bf28d0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.060950 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90a4a61a8684362a261d1a510bf28d0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.068641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90a4a61a8684362a261d1a510bf28d0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.123485 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90a4a61a8684362a261d1a510bf28d0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.136729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90a4a61a8684362a261d1a510bf28d0'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.142924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1301/2594] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:08:40 2022] DELETE /identity/v3/users/d90a4a61a8684362a261d1a510bf28d0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:41.388021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcc245-bfdd-4d5b-9fc4-c4b27c0bbe84 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:41.402522 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcc245-bfdd-4d5b-9fc4-c4b27c0bbe84 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:41.468320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:41.468961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:41.469240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:41.470296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] PATH_INFO: `/v3/projects/536a12bd0bdf4034bccf5839fd3a4997` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:41.472649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536a12bd0bdf4034bccf5839fd3a4997)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:41.474709 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:41.586481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536a12bd0bdf4034bccf5839fd3a4997', 'request_id': 'req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.592654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536a12bd0bdf4034bccf5839fd3a4997', 'request_id': 'req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.678074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536a12bd0bdf4034bccf5839fd3a4997', 'request_id': 'req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.685153 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:41.690454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] The token cache is being invalidate because project 536a12bd0bdf4034bccf5839fd3a4997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:08:41.690750 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.691453 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:41.692964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1294/2595] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:08:41 2022] DELETE /identity/v3/projects/536a12bd0bdf4034bccf5839fd3a4997 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:41.696965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:41.698369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:41.712490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4ce70-c00e-4c08-88e2-05c495989928 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:41.752239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:41.771345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:41.771982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:41.772269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:41.772537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] PATH_INFO: `/v3/users/6c7ce830d8bf481bbd41380256b3454f` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:41.773670 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7ce830d8bf481bbd41380256b3454f)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:41.775646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:42.021493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7ce830d8bf481bbd41380256b3454f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.022147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7ce830d8bf481bbd41380256b3454f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.029739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7ce830d8bf481bbd41380256b3454f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.104336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7ce830d8bf481bbd41380256b3454f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.120603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-9b1b6a88-42b6-44d2-a830-2400f827b1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7ce830d8bf481bbd41380256b3454f'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.127338 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1302/2596] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:08:41 2022] DELETE /identity/v3/users/6c7ce830d8bf481bbd41380256b3454f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:42.363730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:42.365267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:42.381995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e6fd-b5d5-4989-bac1-3ce0ab578de0 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:42.445936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:42.446624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:42.446828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:42.447095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] PATH_INFO: `/v3/projects/24318381916f4eb991fc85569835900c` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:42.448238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24318381916f4eb991fc85569835900c)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:42.450280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:42.582043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24318381916f4eb991fc85569835900c', 'request_id': 'req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.588310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24318381916f4eb991fc85569835900c', 'request_id': 'req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.660986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24318381916f4eb991fc85569835900c', 'request_id': 'req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.672227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] The token cache is being invalidate because project 24318381916f4eb991fc85569835900c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:08:42.673189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.673808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-32b4cb65-2fb8-4aa2-ad17-9c2c85c95bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:08:42.675379 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1295/2597] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:08:42 2022] DELETE /identity/v3/projects/24318381916f4eb991fc85569835900c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:08:42.680468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c09981-cb51-4e68-8990-f9056a829fb3 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:42.680757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c09981-cb51-4e68-8990-f9056a829fb3 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:42.681036 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c09981-cb51-4e68-8990-f9056a829fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:42.701318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-c0c09981-cb51-4e68-8990-f9056a829fb3 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:42.702543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-c0c09981-cb51-4e68-8990-f9056a829fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:42.764018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1303/2598] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:42.772313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67504aea-c1f4-4e93-8b37-d0ff1136b01e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:42.772668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67504aea-c1f4-4e93-8b37-d0ff1136b01e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:42.772948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67504aea-c1f4-4e93-8b37-d0ff1136b01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:42.793680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-67504aea-c1f4-4e93-8b37-d0ff1136b01e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:42.794892 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-67504aea-c1f4-4e93-8b37-d0ff1136b01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:42.804820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1296/2599] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:42.809585 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c09981-cb51-4e68-8990-f9056a829fb3 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:42.819767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c09981-cb51-4e68-8990-f9056a829fb3 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:42.824385 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97aea4-b3c2-4047-acf1-c652b3b98c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:42.824986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97aea4-b3c2-4047-acf1-c652b3b98c21 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:42.825315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97aea4-b3c2-4047-acf1-c652b3b98c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:42.825540 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97aea4-b3c2-4047-acf1-c652b3b98c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:42.826188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97aea4-b3c2-4047-acf1-c652b3b98c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:08:42.826490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97aea4-b3c2-4047-acf1-c652b3b98c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:42.828138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97aea4-b3c2-4047-acf1-c652b3b98c21 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:42.842465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1304/2600] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:08:42.844271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67504aea-c1f4-4e93-8b37-d0ff1136b01e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:42.854904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67504aea-c1f4-4e93-8b37-d0ff1136b01e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:42.860688 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac95c2-5f0c-4cbd-827e-066e723d263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:42.865496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac95c2-5f0c-4cbd-827e-066e723d263e admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:42.865496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac95c2-5f0c-4cbd-827e-066e723d263e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:42.865496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac95c2-5f0c-4cbd-827e-066e723d263e admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:42.865496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac95c2-5f0c-4cbd-827e-066e723d263e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:42.865496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac95c2-5f0c-4cbd-827e-066e723d263e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:42.968573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1297/2601] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:08:42 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:08:42.973387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97aea4-b3c2-4047-acf1-c652b3b98c21 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:42.984725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97aea4-b3c2-4047-acf1-c652b3b98c21 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:43.041477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:43.054757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7a0e-037b-422f-bdb2-d6445a44107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:43.055391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7a0e-037b-422f-bdb2-d6445a44107c admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:43.055671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7a0e-037b-422f-bdb2-d6445a44107c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:43.055942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7a0e-037b-422f-bdb2-d6445a44107c admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:43.056569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7a0e-037b-422f-bdb2-d6445a44107c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:43.058513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7a0e-037b-422f-bdb2-d6445a44107c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:43.161906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1305/2602] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:08:42 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:08:43.166003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac95c2-5f0c-4cbd-827e-066e723d263e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:43.177010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac95c2-5f0c-4cbd-827e-066e723d263e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:43.181549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59706d-90b9-466d-8afd-d754112b1091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:43.182142 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59706d-90b9-466d-8afd-d754112b1091 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:43.182416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59706d-90b9-466d-8afd-d754112b1091 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:43.182685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59706d-90b9-466d-8afd-d754112b1091 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:43.183351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59706d-90b9-466d-8afd-d754112b1091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:43.185001 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59706d-90b9-466d-8afd-d754112b1091 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:43.195793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1298/2603] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:08:43.199850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7a0e-037b-422f-bdb2-d6445a44107c admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:43.212598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7a0e-037b-422f-bdb2-d6445a44107c admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:43.217374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f0d5c-1666-473f-a3d2-007f794dbc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:43.217980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f0d5c-1666-473f-a3d2-007f794dbc33 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:43.218258 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f0d5c-1666-473f-a3d2-007f794dbc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:43.218534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f0d5c-1666-473f-a3d2-007f794dbc33 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:43.219178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f0d5c-1666-473f-a3d2-007f794dbc33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:43.220826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f0d5c-1666-473f-a3d2-007f794dbc33 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:43.233216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1306/2604] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:08:43.238060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59706d-90b9-466d-8afd-d754112b1091 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:43.248265 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59706d-90b9-466d-8afd-d754112b1091 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:43.253713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291a285-e230-40fd-8d69-7f45ac9c59b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:43.254355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291a285-e230-40fd-8d69-7f45ac9c59b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:43.254635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291a285-e230-40fd-8d69-7f45ac9c59b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:43.254909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291a285-e230-40fd-8d69-7f45ac9c59b3 admin admin] PATH_INFO: `/v3/projects/6d490bbbc0f5413f97cf1bd3c1ee4d5f/users/30e0369e60204aaea7723a80fd2ab6bd/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:43.269816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291a285-e230-40fd-8d69-7f45ac9c59b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d490bbbc0f5413f97cf1bd3c1ee4d5f, user_id=30e0369e60204aaea7723a80fd2ab6bd, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:43.272541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291a285-e230-40fd-8d69-7f45ac9c59b3 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:43.335493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1299/2605] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:08:43 2022] PUT /identity/v3/projects/6d490bbbc0f5413f97cf1bd3c1ee4d5f/users/30e0369e60204aaea7723a80fd2ab6bd/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:43.348105 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803438e8-74da-4bb6-9c99-9ee0e4e5d596 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:43.348575 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803438e8-74da-4bb6-9c99-9ee0e4e5d596 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:43.349060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803438e8-74da-4bb6-9c99-9ee0e4e5d596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:43.384417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-803438e8-74da-4bb6-9c99-9ee0e4e5d596 None None] MFA Rules not processed for user `30e0369e60204aaea7723a80fd2ab6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:43.385642 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-803438e8-74da-4bb6-9c99-9ee0e4e5d596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:43.458774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1307/2606] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:08:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:43.463276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291a285-e230-40fd-8d69-7f45ac9c59b3 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:43.490903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:43.526342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291a285-e230-40fd-8d69-7f45ac9c59b3 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:43.530974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc076029-e0e4-44ce-916e-a6eb1f63b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:43.531601 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc076029-e0e4-44ce-916e-a6eb1f63b8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:43.532506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc076029-e0e4-44ce-916e-a6eb1f63b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:43.532720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc076029-e0e4-44ce-916e-a6eb1f63b8a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:43.533350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc076029-e0e4-44ce-916e-a6eb1f63b8a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:43.535286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc076029-e0e4-44ce-916e-a6eb1f63b8a1 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:43.633692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1300/2607] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:08:43 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:08:43.637811 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803438e8-74da-4bb6-9c99-9ee0e4e5d596 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:43.648614 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803438e8-74da-4bb6-9c99-9ee0e4e5d596 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:43.704644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4d23f-23fd-4c2a-b536-44e2affbffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:43.705244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4d23f-23fd-4c2a-b536-44e2affbffab admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:43.705529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4d23f-23fd-4c2a-b536-44e2affbffab admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:43.705782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4d23f-23fd-4c2a-b536-44e2affbffab admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:43.706393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4d23f-23fd-4c2a-b536-44e2affbffab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:43.708365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4d23f-23fd-4c2a-b536-44e2affbffab admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:43.798605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1308/2608] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:08:43 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:08:43.802528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc076029-e0e4-44ce-916e-a6eb1f63b8a1 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:43.812945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc076029-e0e4-44ce-916e-a6eb1f63b8a1 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:43.818384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29e5b-ea42-4dc1-a9d9-f2989640cb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:43.818996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29e5b-ea42-4dc1-a9d9-f2989640cb21 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:43.819321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29e5b-ea42-4dc1-a9d9-f2989640cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:43.819597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29e5b-ea42-4dc1-a9d9-f2989640cb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:43.820238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a29e5b-ea42-4dc1-a9d9-f2989640cb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:43.821831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a29e5b-ea42-4dc1-a9d9-f2989640cb21 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:43.833333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1301/2609] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:08:43.837520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4d23f-23fd-4c2a-b536-44e2affbffab admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:43.847875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4d23f-23fd-4c2a-b536-44e2affbffab admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:43.852448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da26c67-4571-4577-bb09-3d982bffefb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:43.853087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26c67-4571-4577-bb09-3d982bffefb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:43.853363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26c67-4571-4577-bb09-3d982bffefb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:43.853635 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da26c67-4571-4577-bb09-3d982bffefb7 admin admin] PATH_INFO: `/v3/projects/1e7d381168e945ea95e8b423590b26c0/users/352476775d354959832e6458aaf49694/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:43.868495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da26c67-4571-4577-bb09-3d982bffefb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7d381168e945ea95e8b423590b26c0, user_id=352476775d354959832e6458aaf49694, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:43.871166 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da26c67-4571-4577-bb09-3d982bffefb7 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:43.964044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1309/2610] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:08:43 2022] PUT /identity/v3/projects/1e7d381168e945ea95e8b423590b26c0/users/352476775d354959832e6458aaf49694/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:08:43.967995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29e5b-ea42-4dc1-a9d9-f2989640cb21 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:43.978231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29e5b-ea42-4dc1-a9d9-f2989640cb21 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:44.035061 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955628-78d2-4c80-96c9-a9dcfe1a94f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:44.035700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955628-78d2-4c80-96c9-a9dcfe1a94f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:44.035975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955628-78d2-4c80-96c9-a9dcfe1a94f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:44.036243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955628-78d2-4c80-96c9-a9dcfe1a94f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:44.036909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955628-78d2-4c80-96c9-a9dcfe1a94f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:44.038505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955628-78d2-4c80-96c9-a9dcfe1a94f4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:44.048783 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1302/2611] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:08:44.052920 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da26c67-4571-4577-bb09-3d982bffefb7 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:44.063930 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da26c67-4571-4577-bb09-3d982bffefb7 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:44.068617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aee19-26d4-45d6-816c-6a0138f339bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:44.069261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aee19-26d4-45d6-816c-6a0138f339bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:44.069597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aee19-26d4-45d6-816c-6a0138f339bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:44.069871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831aee19-26d4-45d6-816c-6a0138f339bb admin admin] PATH_INFO: `/v3/projects/1e7d381168e945ea95e8b423590b26c0/users/352476775d354959832e6458aaf49694/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:44.071821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aee19-26d4-45d6-816c-6a0138f339bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7d381168e945ea95e8b423590b26c0, user_id=352476775d354959832e6458aaf49694, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:44.074461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831aee19-26d4-45d6-816c-6a0138f339bb admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:44.084691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1310/2612] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:08:44 2022] PUT /identity/v3/projects/1e7d381168e945ea95e8b423590b26c0/users/352476775d354959832e6458aaf49694/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:08:44.094822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636dcc5-627b-4878-837e-fb3d4ad93814 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:44.095075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636dcc5-627b-4878-837e-fb3d4ad93814 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:44.095394 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636dcc5-627b-4878-837e-fb3d4ad93814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:44.124234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d636dcc5-627b-4878-837e-fb3d4ad93814 None None] MFA Rules not processed for user `352476775d354959832e6458aaf49694`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:08:44.125452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d636dcc5-627b-4878-837e-fb3d4ad93814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:44.195441 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1303/2613] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:08:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:08:44.207019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aee19-26d4-45d6-816c-6a0138f339bb admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:44.208776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-831aee19-26d4-45d6-816c-6a0138f339bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:08:44.218597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:44.268139 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831aee19-26d4-45d6-816c-6a0138f339bb admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:44.271807 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a03ac-75ba-4f90-974e-cf76e2cb69ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:44.272404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a03ac-75ba-4f90-974e-cf76e2cb69ec service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:44.272685 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a03ac-75ba-4f90-974e-cf76e2cb69ec service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:44.272953 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a03ac-75ba-4f90-974e-cf76e2cb69ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:44.282532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a03ac-75ba-4f90-974e-cf76e2cb69ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:44.284486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a03ac-75ba-4f90-974e-cf76e2cb69ec service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:44.294685 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1311/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:08:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:08:44.481402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636dcc5-627b-4878-837e-fb3d4ad93814 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:08:44.492087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636dcc5-627b-4878-837e-fb3d4ad93814 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:08:44.495728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1881a12-845f-4132-bf0b-3a0f0ff5c308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:08:44.496321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1881a12-845f-4132-bf0b-3a0f0ff5c308 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:08:44.496597 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1881a12-845f-4132-bf0b-3a0f0ff5c308 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:08:44.496867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1881a12-845f-4132-bf0b-3a0f0ff5c308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:08:44.514007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:44.556633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1881a12-845f-4132-bf0b-3a0f0ff5c308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:08:44.558013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1881a12-845f-4132-bf0b-3a0f0ff5c308 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:08:44.567575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1304/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:08:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:08:54.290403 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=23 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:08:54.580939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=19 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:18.874006 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a03ac-75ba-4f90-974e-cf76e2cb69ec service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:18.875770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-4e5a03ac-75ba-4f90-974e-cf76e2cb69ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:18.955275 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a03ac-75ba-4f90-974e-cf76e2cb69ec service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:18.963802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79f03-ccc9-4bf1-aa79-e3ad73fe1d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:18.964883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79f03-ccc9-4bf1-aa79-e3ad73fe1d1e service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:18.965357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79f03-ccc9-4bf1-aa79-e3ad73fe1d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:18.965848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79f03-ccc9-4bf1-aa79-e3ad73fe1d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:18.968768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-84f79f03-ccc9-4bf1-aa79-e3ad73fe1d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:19.095884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f79f03-ccc9-4bf1-aa79-e3ad73fe1d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:19.097467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f79f03-ccc9-4bf1-aa79-e3ad73fe1d1e service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:19.119079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1312/2616] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:20.314686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1881a12-845f-4132-bf0b-3a0f0ff5c308 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:20.325655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1881a12-845f-4132-bf0b-3a0f0ff5c308 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:20.330368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561be39-e964-4a82-9e3f-67b84dc4ceed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:20.331328 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561be39-e964-4a82-9e3f-67b84dc4ceed service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:20.331801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561be39-e964-4a82-9e3f-67b84dc4ceed service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:20.332262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561be39-e964-4a82-9e3f-67b84dc4ceed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:20.334781 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5561be39-e964-4a82-9e3f-67b84dc4ceed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:20.350870 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561be39-e964-4a82-9e3f-67b84dc4ceed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:20.352374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561be39-e964-4a82-9e3f-67b84dc4ceed service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:20.364987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1305/2617] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:22.243921 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79f03-ccc9-4bf1-aa79-e3ad73fe1d1e service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:22.321153 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79f03-ccc9-4bf1-aa79-e3ad73fe1d1e service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:22.326082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:22.326834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:22.327208 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:22.327625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] PATH_INFO: `/v3/users/30e0369e60204aaea7723a80fd2ab6bd` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:22.328919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e0369e60204aaea7723a80fd2ab6bd)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:22.330996 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:22.361820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:22.558836 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e0369e60204aaea7723a80fd2ab6bd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:22.559558 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e0369e60204aaea7723a80fd2ab6bd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:22.568373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e0369e60204aaea7723a80fd2ab6bd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:22.686187 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e0369e60204aaea7723a80fd2ab6bd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:22.720737 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e0369e60204aaea7723a80fd2ab6bd'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:22.733795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1313/2618] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:09:22 2022] DELETE /identity/v3/users/30e0369e60204aaea7723a80fd2ab6bd => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:22.740869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3bb76-0aed-4fcc-9d5a-85863ba8cb43 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:22.743754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3bb76-0aed-4fcc-9d5a-85863ba8cb43 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:22.743754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3bb76-0aed-4fcc-9d5a-85863ba8cb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:22.772339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-1df3bb76-0aed-4fcc-9d5a-85863ba8cb43 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:22.774453 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1df3bb76-0aed-4fcc-9d5a-85863ba8cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:22.870338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1306/2619] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:22.884546 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:22.886651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:22.982557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3ad93-9e96-4771-9723-7fb8c6970422 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:22.989240 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f42f4-fa8e-4228-9572-fbbbe19ad3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:22.994631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f42f4-fa8e-4228-9572-fbbbe19ad3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:22.994631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f42f4-fa8e-4228-9572-fbbbe19ad3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:22.994631 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f42f4-fa8e-4228-9572-fbbbe19ad3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:23.000771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f42f4-fa8e-4228-9572-fbbbe19ad3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:23.002236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f42f4-fa8e-4228-9572-fbbbe19ad3c7 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:23.013380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1314/2620] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:09:23.498159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3bb76-0aed-4fcc-9d5a-85863ba8cb43 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:23.498159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1df3bb76-0aed-4fcc-9d5a-85863ba8cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:23.510907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3bb76-0aed-4fcc-9d5a-85863ba8cb43 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:23.515555 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:23.520260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:23.521064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:23.521560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] PATH_INFO: `/v3/projects/6d490bbbc0f5413f97cf1bd3c1ee4d5f` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:23.522915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d490bbbc0f5413f97cf1bd3c1ee4d5f)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:23.530492 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:23.646990 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d490bbbc0f5413f97cf1bd3c1ee4d5f', 'request_id': 'req-a542f65e-b499-4ba9-acce-fd928d9f7980'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:23.652883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d490bbbc0f5413f97cf1bd3c1ee4d5f', 'request_id': 'req-a542f65e-b499-4ba9-acce-fd928d9f7980'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:23.723054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d490bbbc0f5413f97cf1bd3c1ee4d5f', 'request_id': 'req-a542f65e-b499-4ba9-acce-fd928d9f7980'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:23.734800 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] The token cache is being invalidate because project 6d490bbbc0f5413f97cf1bd3c1ee4d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:09:23.735088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:23.735736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:23.737211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1307/2621] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:09:23 2022] DELETE /identity/v3/projects/6d490bbbc0f5413f97cf1bd3c1ee4d5f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:23.741866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f42f4-fa8e-4228-9572-fbbbe19ad3c7 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:23.751831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f42f4-fa8e-4228-9572-fbbbe19ad3c7 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:23.941413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:23.942044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:23.942322 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:23.942594 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] PATH_INFO: `/v3/users/352476775d354959832e6458aaf49694` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:23.944182 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352476775d354959832e6458aaf49694)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:23.953043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:24.123678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:24.125177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352476775d354959832e6458aaf49694'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:24.125833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352476775d354959832e6458aaf49694'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:24.132869 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352476775d354959832e6458aaf49694'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:24.186657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352476775d354959832e6458aaf49694'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:24.200597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-20452f91-1f8a-4f42-9636-0ca37b4dbe25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352476775d354959832e6458aaf49694'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:24.206774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1315/2622] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:09:23 2022] DELETE /identity/v3/users/352476775d354959832e6458aaf49694 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:24.733336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:24.734805 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:24.750378 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542f65e-b499-4ba9-acce-fd928d9f7980 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:24.812979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:24.813619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:24.813897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:24.814169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] PATH_INFO: `/v3/projects/1e7d381168e945ea95e8b423590b26c0` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:24.815326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7d381168e945ea95e8b423590b26c0)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:24.817278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:24.830030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:24.945056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7d381168e945ea95e8b423590b26c0', 'request_id': 'req-826e8cd5-990d-407f-8a2d-d456719e5c25'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:24.951357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7d381168e945ea95e8b423590b26c0', 'request_id': 'req-826e8cd5-990d-407f-8a2d-d456719e5c25'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:25.037048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7d381168e945ea95e8b423590b26c0', 'request_id': 'req-826e8cd5-990d-407f-8a2d-d456719e5c25'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:25.048956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] The token cache is being invalidate because project 1e7d381168e945ea95e8b423590b26c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:09:25.049242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:25.049885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-826e8cd5-990d-407f-8a2d-d456719e5c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:25.051410 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1308/2623] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:09:24 2022] DELETE /identity/v3/projects/1e7d381168e945ea95e8b423590b26c0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:25.057031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4321152-6bf3-463b-a0c8-3625566873c6 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.057592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4321152-6bf3-463b-a0c8-3625566873c6 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.057592 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4321152-6bf3-463b-a0c8-3625566873c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.077509 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b4321152-6bf3-463b-a0c8-3625566873c6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:25.078727 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b4321152-6bf3-463b-a0c8-3625566873c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:25.141715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1316/2624] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:25.149974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6824f5-235f-428f-b8b7-aad9719f3286 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.150298 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6824f5-235f-428f-b8b7-aad9719f3286 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.154229 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6824f5-235f-428f-b8b7-aad9719f3286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.170392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-cc6824f5-235f-428f-b8b7-aad9719f3286 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:25.171650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cc6824f5-235f-428f-b8b7-aad9719f3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:25.180878 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1309/2625] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:25.185256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4321152-6bf3-463b-a0c8-3625566873c6 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:25.196125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4321152-6bf3-463b-a0c8-3625566873c6 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:25.200733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c3f29-9f95-4282-8fe8-5a9ea22056ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:25.201475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c3f29-9f95-4282-8fe8-5a9ea22056ec admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.201758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c3f29-9f95-4282-8fe8-5a9ea22056ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.202027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c3f29-9f95-4282-8fe8-5a9ea22056ec admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.202689 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c3f29-9f95-4282-8fe8-5a9ea22056ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:09:25.202988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c3f29-9f95-4282-8fe8-5a9ea22056ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:25.204639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c3f29-9f95-4282-8fe8-5a9ea22056ec admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:25.220549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1317/2626] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:09:25.221953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6824f5-235f-428f-b8b7-aad9719f3286 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:25.233548 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6824f5-235f-428f-b8b7-aad9719f3286 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:25.238295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80a7ad-b64e-465d-ae74-878e5cf63497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:25.238940 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80a7ad-b64e-465d-ae74-878e5cf63497 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.239832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80a7ad-b64e-465d-ae74-878e5cf63497 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.240110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80a7ad-b64e-465d-ae74-878e5cf63497 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.240930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80a7ad-b64e-465d-ae74-878e5cf63497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:25.242923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80a7ad-b64e-465d-ae74-878e5cf63497 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:25.347306 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1310/2627] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:09:25 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:25.351668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c3f29-9f95-4282-8fe8-5a9ea22056ec admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:25.362256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c3f29-9f95-4282-8fe8-5a9ea22056ec admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:25.427710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4576c-a675-41e3-a230-8d2f836b55cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:25.428571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4576c-a675-41e3-a230-8d2f836b55cd admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.428855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4576c-a675-41e3-a230-8d2f836b55cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.429129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4576c-a675-41e3-a230-8d2f836b55cd admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.429772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4576c-a675-41e3-a230-8d2f836b55cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:25.431753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4576c-a675-41e3-a230-8d2f836b55cd admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:25.538075 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1318/2628] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:09:25 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:25.542430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80a7ad-b64e-465d-ae74-878e5cf63497 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:25.553331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80a7ad-b64e-465d-ae74-878e5cf63497 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:25.558146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721294e7-8381-4a5b-a0e7-1b8ee65cf726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:25.558755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721294e7-8381-4a5b-a0e7-1b8ee65cf726 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.559040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721294e7-8381-4a5b-a0e7-1b8ee65cf726 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.559351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721294e7-8381-4a5b-a0e7-1b8ee65cf726 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.560081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721294e7-8381-4a5b-a0e7-1b8ee65cf726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:25.561687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721294e7-8381-4a5b-a0e7-1b8ee65cf726 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:25.574258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1311/2629] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:25.579946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4576c-a675-41e3-a230-8d2f836b55cd admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:25.591300 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4576c-a675-41e3-a230-8d2f836b55cd admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:25.597359 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a681eb-4071-4d0f-8c99-75ba79bc401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:25.597961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a681eb-4071-4d0f-8c99-75ba79bc401d admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.598242 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a681eb-4071-4d0f-8c99-75ba79bc401d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.598868 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a681eb-4071-4d0f-8c99-75ba79bc401d admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.599383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a681eb-4071-4d0f-8c99-75ba79bc401d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:25.601026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a681eb-4071-4d0f-8c99-75ba79bc401d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:25.612428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1319/2630] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:25.617198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721294e7-8381-4a5b-a0e7-1b8ee65cf726 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:25.627559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721294e7-8381-4a5b-a0e7-1b8ee65cf726 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:25.632723 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc9d1e-ccbb-44ab-97dc-739e7a6f1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:25.633370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc9d1e-ccbb-44ab-97dc-739e7a6f1b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.633648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc9d1e-ccbb-44ab-97dc-739e7a6f1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.633918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc9d1e-ccbb-44ab-97dc-739e7a6f1b9c admin admin] PATH_INFO: `/v3/projects/ab9d54fbfd2a456f87296c3de15d3b5e/users/79ac3436d4c64aa697da8e9c2536491a/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.650443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc9d1e-ccbb-44ab-97dc-739e7a6f1b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9d54fbfd2a456f87296c3de15d3b5e, user_id=79ac3436d4c64aa697da8e9c2536491a, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:25.653322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc9d1e-ccbb-44ab-97dc-739e7a6f1b9c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:25.743766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1312/2631] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:09:25 2022] PUT /identity/v3/projects/ab9d54fbfd2a456f87296c3de15d3b5e/users/79ac3436d4c64aa697da8e9c2536491a/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:25.754445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632cecf-cf28-45b5-8fd6-10ac7bfe5acb None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.754731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632cecf-cf28-45b5-8fd6-10ac7bfe5acb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.755758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632cecf-cf28-45b5-8fd6-10ac7bfe5acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.787786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-f632cecf-cf28-45b5-8fd6-10ac7bfe5acb None None] MFA Rules not processed for user `79ac3436d4c64aa697da8e9c2536491a`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:25.789101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f632cecf-cf28-45b5-8fd6-10ac7bfe5acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:25.807468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:25.856750 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1320/2632] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:25.861425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc9d1e-ccbb-44ab-97dc-739e7a6f1b9c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:25.927656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc9d1e-ccbb-44ab-97dc-739e7a6f1b9c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:25.932675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db7f99-7b04-413f-b324-d80be8d7ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:25.933289 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7f99-7b04-413f-b324-d80be8d7ee8b admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:25.933567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7f99-7b04-413f-b324-d80be8d7ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:25.933837 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7f99-7b04-413f-b324-d80be8d7ee8b admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:25.934471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db7f99-7b04-413f-b324-d80be8d7ee8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:25.936460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db7f99-7b04-413f-b324-d80be8d7ee8b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:26.019077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1313/2633] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:09:25 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:26.023458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632cecf-cf28-45b5-8fd6-10ac7bfe5acb None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:26.034216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632cecf-cf28-45b5-8fd6-10ac7bfe5acb None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:26.092081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81997-dc95-45f4-90e7-3ebb9457d21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:26.092728 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81997-dc95-45f4-90e7-3ebb9457d21f admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.092861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81997-dc95-45f4-90e7-3ebb9457d21f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.093135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81997-dc95-45f4-90e7-3ebb9457d21f admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.093772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf81997-dc95-45f4-90e7-3ebb9457d21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:26.095739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf81997-dc95-45f4-90e7-3ebb9457d21f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:26.206640 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1321/2634] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:09:26 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:26.210732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db7f99-7b04-413f-b324-d80be8d7ee8b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:26.221094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db7f99-7b04-413f-b324-d80be8d7ee8b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:26.226445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9acf4-acff-4b3e-883a-63c124934627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:26.227049 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9acf4-acff-4b3e-883a-63c124934627 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.227359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9acf4-acff-4b3e-883a-63c124934627 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.227633 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9acf4-acff-4b3e-883a-63c124934627 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.228284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9acf4-acff-4b3e-883a-63c124934627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:26.230146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9acf4-acff-4b3e-883a-63c124934627 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:26.242037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1314/2635] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:26.246288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81997-dc95-45f4-90e7-3ebb9457d21f admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:26.257226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81997-dc95-45f4-90e7-3ebb9457d21f admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:26.261955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13072912-1fcf-4f2a-b18a-9fe549564ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:26.262556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13072912-1fcf-4f2a-b18a-9fe549564ebf admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.262834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13072912-1fcf-4f2a-b18a-9fe549564ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.263104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13072912-1fcf-4f2a-b18a-9fe549564ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.263787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13072912-1fcf-4f2a-b18a-9fe549564ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:26.265398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13072912-1fcf-4f2a-b18a-9fe549564ebf admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:26.280706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1322/2636] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:26.281006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9acf4-acff-4b3e-883a-63c124934627 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:26.286671 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:26.292316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9acf4-acff-4b3e-883a-63c124934627 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:26.297084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85a88d-ba32-48e5-9b14-4b8e965aa82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:26.297766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85a88d-ba32-48e5-9b14-4b8e965aa82c admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.308667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85a88d-ba32-48e5-9b14-4b8e965aa82c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.308667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85a88d-ba32-48e5-9b14-4b8e965aa82c admin admin] PATH_INFO: `/v3/projects/13b96c8b95bf40ef8ddc69a63177ec57/users/d602efb8ceb045feb293081ade7d9b98/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.321655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85a88d-ba32-48e5-9b14-4b8e965aa82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b96c8b95bf40ef8ddc69a63177ec57, user_id=d602efb8ceb045feb293081ade7d9b98, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:26.323440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85a88d-ba32-48e5-9b14-4b8e965aa82c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:26.377020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13072912-1fcf-4f2a-b18a-9fe549564ebf admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:26.378759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-13072912-1fcf-4f2a-b18a-9fe549564ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:26.423448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1315/2637] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:09:26 2022] PUT /identity/v3/projects/13b96c8b95bf40ef8ddc69a63177ec57/users/d602efb8ceb045feb293081ade7d9b98/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:09:26.435904 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df06c54-6832-4122-97cb-5b400e9962f5 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.436192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df06c54-6832-4122-97cb-5b400e9962f5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.436464 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df06c54-6832-4122-97cb-5b400e9962f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.444530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13072912-1fcf-4f2a-b18a-9fe549564ebf admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:26.464661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3df06c54-6832-4122-97cb-5b400e9962f5 None None] MFA Rules not processed for user `d602efb8ceb045feb293081ade7d9b98`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:26.465925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3df06c54-6832-4122-97cb-5b400e9962f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:26.498349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eba6f6-798e-4192-973c-9c1e2452a96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:26.498973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eba6f6-798e-4192-973c-9c1e2452a96b service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.499315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eba6f6-798e-4192-973c-9c1e2452a96b service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.499587 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eba6f6-798e-4192-973c-9c1e2452a96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.501329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-34eba6f6-798e-4192-973c-9c1e2452a96b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:26.507291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:26.531708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1316/2638] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:09:26.536760 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df06c54-6832-4122-97cb-5b400e9962f5 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:26.568308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eba6f6-798e-4192-973c-9c1e2452a96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:26.569773 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eba6f6-798e-4192-973c-9c1e2452a96b service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:26.580128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1323/2639] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:09:26.601194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df06c54-6832-4122-97cb-5b400e9962f5 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:26.606016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804714f-6358-42cc-a2a3-cb43fca635fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:26.606623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804714f-6358-42cc-a2a3-cb43fca635fb admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.606899 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804714f-6358-42cc-a2a3-cb43fca635fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.607169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804714f-6358-42cc-a2a3-cb43fca635fb admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.607842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804714f-6358-42cc-a2a3-cb43fca635fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:26.609754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804714f-6358-42cc-a2a3-cb43fca635fb admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:26.722140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1317/2640] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:09:26 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:09:26.727052 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eba6f6-798e-4192-973c-9c1e2452a96b service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:26.737123 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eba6f6-798e-4192-973c-9c1e2452a96b service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:26.795686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6616ed6-2596-49b7-ac06-d2b9a292cbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:26.796348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6616ed6-2596-49b7-ac06-d2b9a292cbfb admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.796630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6616ed6-2596-49b7-ac06-d2b9a292cbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.796899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6616ed6-2596-49b7-ac06-d2b9a292cbfb admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.797521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6616ed6-2596-49b7-ac06-d2b9a292cbfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:26.799457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6616ed6-2596-49b7-ac06-d2b9a292cbfb admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:26.886990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1324/2641] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:09:26 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:26.891645 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804714f-6358-42cc-a2a3-cb43fca635fb admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:26.902986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804714f-6358-42cc-a2a3-cb43fca635fb admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:26.907801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9824-c958-478b-aa91-271aaa48508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:26.908406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9824-c958-478b-aa91-271aaa48508b admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.908685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9824-c958-478b-aa91-271aaa48508b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.908956 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9824-c958-478b-aa91-271aaa48508b admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.909658 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce9824-c958-478b-aa91-271aaa48508b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:26.911824 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce9824-c958-478b-aa91-271aaa48508b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:26.926056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1318/2642] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:26.927969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6616ed6-2596-49b7-ac06-d2b9a292cbfb admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:26.938065 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6616ed6-2596-49b7-ac06-d2b9a292cbfb admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:26.942780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab068780-974e-4e34-8e6e-db9fcb694510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:26.943461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab068780-974e-4e34-8e6e-db9fcb694510 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:26.943740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab068780-974e-4e34-8e6e-db9fcb694510 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:26.944009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab068780-974e-4e34-8e6e-db9fcb694510 admin admin] PATH_INFO: `/v3/projects/c34398df4719473aaf96444afda71808/users/20d113baccb34ee195271c041f2fd7be/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:26.958783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab068780-974e-4e34-8e6e-db9fcb694510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34398df4719473aaf96444afda71808, user_id=20d113baccb34ee195271c041f2fd7be, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:26.961473 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab068780-974e-4e34-8e6e-db9fcb694510 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:27.058739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1325/2643] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:09:26 2022] PUT /identity/v3/projects/c34398df4719473aaf96444afda71808/users/20d113baccb34ee195271c041f2fd7be/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:27.062645 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9824-c958-478b-aa91-271aaa48508b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:27.073719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9824-c958-478b-aa91-271aaa48508b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:27.116296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:27.133085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1161-bcb7-4f62-9a19-53f507540b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:27.133730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1161-bcb7-4f62-9a19-53f507540b3f admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:27.134010 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1161-bcb7-4f62-9a19-53f507540b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:27.134285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1161-bcb7-4f62-9a19-53f507540b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:27.134943 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1161-bcb7-4f62-9a19-53f507540b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:27.136643 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1161-bcb7-4f62-9a19-53f507540b3f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:27.147473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1319/2644] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:27.151525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab068780-974e-4e34-8e6e-db9fcb694510 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:27.162767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab068780-974e-4e34-8e6e-db9fcb694510 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:27.167444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201136a5-3df1-43aa-833a-3166179c5ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:27.168089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201136a5-3df1-43aa-833a-3166179c5ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:27.168362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201136a5-3df1-43aa-833a-3166179c5ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:27.168630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201136a5-3df1-43aa-833a-3166179c5ab3 admin admin] PATH_INFO: `/v3/projects/c34398df4719473aaf96444afda71808/users/20d113baccb34ee195271c041f2fd7be/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:27.170552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201136a5-3df1-43aa-833a-3166179c5ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34398df4719473aaf96444afda71808, user_id=20d113baccb34ee195271c041f2fd7be, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:27.173215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201136a5-3df1-43aa-833a-3166179c5ab3 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:27.184456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1326/2645] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:09:27 2022] PUT /identity/v3/projects/c34398df4719473aaf96444afda71808/users/20d113baccb34ee195271c041f2fd7be/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:09:27.195586 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db145c7-1f76-4856-be16-7f0097501ab5 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:27.195875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db145c7-1f76-4856-be16-7f0097501ab5 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:27.196143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db145c7-1f76-4856-be16-7f0097501ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:27.225002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-6db145c7-1f76-4856-be16-7f0097501ab5 None None] MFA Rules not processed for user `20d113baccb34ee195271c041f2fd7be`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:27.226224 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6db145c7-1f76-4856-be16-7f0097501ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:27.297663 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1320/2646] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:27.308797 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201136a5-3df1-43aa-833a-3166179c5ab3 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:27.310506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-201136a5-3df1-43aa-833a-3166179c5ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:27.370304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201136a5-3df1-43aa-833a-3166179c5ab3 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:27.373939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aad4a-3008-4fc1-bd58-47bb5ed57007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:27.374539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aad4a-3008-4fc1-bd58-47bb5ed57007 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:27.374812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aad4a-3008-4fc1-bd58-47bb5ed57007 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:27.375079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aad4a-3008-4fc1-bd58-47bb5ed57007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:27.385513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aad4a-3008-4fc1-bd58-47bb5ed57007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:27.387000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aad4a-3008-4fc1-bd58-47bb5ed57007 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:27.391018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:27.398982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1327/2647] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:28.619393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db145c7-1f76-4856-be16-7f0097501ab5 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:28.625490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6db145c7-1f76-4856-be16-7f0097501ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:28.638214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db145c7-1f76-4856-be16-7f0097501ab5 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:28.643505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66715c6e-7f9a-4db4-8b40-f25f39d7fc0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:28.644165 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66715c6e-7f9a-4db4-8b40-f25f39d7fc0c service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:28.644449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66715c6e-7f9a-4db4-8b40-f25f39d7fc0c service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:28.644722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66715c6e-7f9a-4db4-8b40-f25f39d7fc0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:28.732098 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66715c6e-7f9a-4db4-8b40-f25f39d7fc0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:28.734755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66715c6e-7f9a-4db4-8b40-f25f39d7fc0c service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:28.748191 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1321/2648] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:30.725714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aad4a-3008-4fc1-bd58-47bb5ed57007 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:30.727878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-082aad4a-3008-4fc1-bd58-47bb5ed57007 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:30.799886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aad4a-3008-4fc1-bd58-47bb5ed57007 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:30.804700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:30.805333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:30.805611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:30.805876 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] PATH_INFO: `/v3/users/e6d3fd0d74c94f88aef2f0be0047ee9a` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:30.823762 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d3fd0d74c94f88aef2f0be0047ee9a)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:30.825733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:31.039005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d3fd0d74c94f88aef2f0be0047ee9a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.039712 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d3fd0d74c94f88aef2f0be0047ee9a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.046756 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d3fd0d74c94f88aef2f0be0047ee9a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.140174 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d3fd0d74c94f88aef2f0be0047ee9a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.154015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-c6f10d2a-0e64-48b6-8e7b-8d36ed798788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d3fd0d74c94f88aef2f0be0047ee9a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.160060 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1328/2649] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:09:30 2022] DELETE /identity/v3/users/e6d3fd0d74c94f88aef2f0be0047ee9a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:31.436745 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66715c6e-7f9a-4db4-8b40-f25f39d7fc0c service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:31.450622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66715c6e-7f9a-4db4-8b40-f25f39d7fc0c service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:31.513374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:31.514012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:31.514288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:31.514561 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] PATH_INFO: `/v3/projects/10c85f50b92b497a883fe416cc6c7de6` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:31.517496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:31.527038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c85f50b92b497a883fe416cc6c7de6)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:31.528931 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:31.663973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c85f50b92b497a883fe416cc6c7de6', 'request_id': 'req-b097db57-46e0-4bd2-aba5-146356558daf'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.801212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c85f50b92b497a883fe416cc6c7de6', 'request_id': 'req-b097db57-46e0-4bd2-aba5-146356558daf'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.862743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c85f50b92b497a883fe416cc6c7de6', 'request_id': 'req-b097db57-46e0-4bd2-aba5-146356558daf'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.875030 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] The token cache is being invalidate because project 10c85f50b92b497a883fe416cc6c7de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:09:31.875346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.876022 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-b097db57-46e0-4bd2-aba5-146356558daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:31.877550 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1322/2650] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:09:31 2022] DELETE /identity/v3/projects/10c85f50b92b497a883fe416cc6c7de6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:09:31.883581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8496a-9d2a-40fa-8f1d-7ef7acfc9cb4 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:31.884176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8496a-9d2a-40fa-8f1d-7ef7acfc9cb4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:31.884176 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8496a-9d2a-40fa-8f1d-7ef7acfc9cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:31.904423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-64c8496a-9d2a-40fa-8f1d-7ef7acfc9cb4 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:31.905648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-64c8496a-9d2a-40fa-8f1d-7ef7acfc9cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:31.969393 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1329/2651] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:31.978152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedd9e3-aec2-4ff1-84b2-755cbe18edbf None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:31.978433 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedd9e3-aec2-4ff1-84b2-755cbe18edbf None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:31.978881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedd9e3-aec2-4ff1-84b2-755cbe18edbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:32.000018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-1cedd9e3-aec2-4ff1-84b2-755cbe18edbf None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:32.001763 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1cedd9e3-aec2-4ff1-84b2-755cbe18edbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:32.011140 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1323/2652] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:32.016067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8496a-9d2a-40fa-8f1d-7ef7acfc9cb4 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:32.027407 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8496a-9d2a-40fa-8f1d-7ef7acfc9cb4 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:32.032102 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa35e09-4080-44f5-ba6d-b957d522fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:32.032708 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35e09-4080-44f5-ba6d-b957d522fc76 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:32.032995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35e09-4080-44f5-ba6d-b957d522fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:32.033271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35e09-4080-44f5-ba6d-b957d522fc76 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:32.034061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35e09-4080-44f5-ba6d-b957d522fc76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:09:32.034366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35e09-4080-44f5-ba6d-b957d522fc76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:32.036031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35e09-4080-44f5-ba6d-b957d522fc76 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:32.041418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:32.050784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1330/2653] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:09:32.055426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedd9e3-aec2-4ff1-84b2-755cbe18edbf None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:32.064982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedd9e3-aec2-4ff1-84b2-755cbe18edbf None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:32.070233 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a042dc-c562-4936-ae22-017492adb6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:32.070839 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a042dc-c562-4936-ae22-017492adb6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:32.071117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a042dc-c562-4936-ae22-017492adb6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:32.071430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a042dc-c562-4936-ae22-017492adb6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:32.072073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a042dc-c562-4936-ae22-017492adb6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:32.073992 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a042dc-c562-4936-ae22-017492adb6b3 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:32.164337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1324/2654] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:09:32 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:32.169051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa35e09-4080-44f5-ba6d-b957d522fc76 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:32.179492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa35e09-4080-44f5-ba6d-b957d522fc76 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:32.238197 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679ef6d-146c-4290-865c-e9e8d712cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:32.238808 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679ef6d-146c-4290-865c-e9e8d712cd2f admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:32.239088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679ef6d-146c-4290-865c-e9e8d712cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:32.239395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679ef6d-146c-4290-865c-e9e8d712cd2f admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:32.245408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679ef6d-146c-4290-865c-e9e8d712cd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:32.245408 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679ef6d-146c-4290-865c-e9e8d712cd2f admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:32.323358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1331/2655] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:09:32 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:32.327718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a042dc-c562-4936-ae22-017492adb6b3 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:32.338585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a042dc-c562-4936-ae22-017492adb6b3 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:32.343416 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074910c7-9697-43f2-a69f-c8dc77fa3f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:32.344023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074910c7-9697-43f2-a69f-c8dc77fa3f84 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:32.344303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074910c7-9697-43f2-a69f-c8dc77fa3f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:32.344573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074910c7-9697-43f2-a69f-c8dc77fa3f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:32.345236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074910c7-9697-43f2-a69f-c8dc77fa3f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:32.346827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074910c7-9697-43f2-a69f-c8dc77fa3f84 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:32.358369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1325/2656] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:32.362523 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679ef6d-146c-4290-865c-e9e8d712cd2f admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:32.373478 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679ef6d-146c-4290-865c-e9e8d712cd2f admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:32.378144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d915ec-50ef-40ee-83ee-46f212643f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:32.378772 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d915ec-50ef-40ee-83ee-46f212643f96 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:32.379050 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d915ec-50ef-40ee-83ee-46f212643f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:32.379353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d915ec-50ef-40ee-83ee-46f212643f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:32.379995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d915ec-50ef-40ee-83ee-46f212643f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:32.381781 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d915ec-50ef-40ee-83ee-46f212643f96 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:32.393942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1332/2657] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:32.408000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074910c7-9697-43f2-a69f-c8dc77fa3f84 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:32.422408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074910c7-9697-43f2-a69f-c8dc77fa3f84 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:32.427128 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff21ce-2a6f-4d1f-a4a3-3c2a9f2e5cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:32.428214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff21ce-2a6f-4d1f-a4a3-3c2a9f2e5cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:32.429145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff21ce-2a6f-4d1f-a4a3-3c2a9f2e5cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:32.429425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff21ce-2a6f-4d1f-a4a3-3c2a9f2e5cf6 admin admin] PATH_INFO: `/v3/projects/dfd76cd8f8f649b3a6231c2f12d530ba/users/c81fde029db243a7935e3e90cef369e4/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:32.446151 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff21ce-2a6f-4d1f-a4a3-3c2a9f2e5cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd76cd8f8f649b3a6231c2f12d530ba, user_id=c81fde029db243a7935e3e90cef369e4, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:32.448981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff21ce-2a6f-4d1f-a4a3-3c2a9f2e5cf6 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:32.517969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1326/2658] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:09:32 2022] PUT /identity/v3/projects/dfd76cd8f8f649b3a6231c2f12d530ba/users/c81fde029db243a7935e3e90cef369e4/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:32.524514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2887ca-8ba3-4238-aece-5965596aca54 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:32.524514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2887ca-8ba3-4238-aece-5965596aca54 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:32.524770 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2887ca-8ba3-4238-aece-5965596aca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:32.545683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ae2887ca-8ba3-4238-aece-5965596aca54 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:32.546923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ae2887ca-8ba3-4238-aece-5965596aca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:32.610367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1333/2659] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:09:32.619934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff21ce-2a6f-4d1f-a4a3-3c2a9f2e5cf6 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:32.621725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3aff21ce-2a6f-4d1f-a4a3-3c2a9f2e5cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:32.680493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff21ce-2a6f-4d1f-a4a3-3c2a9f2e5cf6 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:32.684200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cadadc-d319-4db7-8dd8-2eb8930279d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:32.684810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cadadc-d319-4db7-8dd8-2eb8930279d6 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:32.685087 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cadadc-d319-4db7-8dd8-2eb8930279d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:32.685359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cadadc-d319-4db7-8dd8-2eb8930279d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:32.695335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cadadc-d319-4db7-8dd8-2eb8930279d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:32.696782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cadadc-d319-4db7-8dd8-2eb8930279d6 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:32.706726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1327/2660] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:33.778602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2887ca-8ba3-4238-aece-5965596aca54 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:33.780135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ae2887ca-8ba3-4238-aece-5965596aca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:33.841374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2887ca-8ba3-4238-aece-5965596aca54 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:33.844951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:33.846221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:33.846506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:33.846805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:33.848641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:33.883741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:33.919379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:33.920871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:33.942893 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1334/2661] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:38.268222 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12d18f-cf93-46dc-a60c-676d8ac9b45f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:38.268681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12d18f-cf93-46dc-a60c-676d8ac9b45f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:38.268791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12d18f-cf93-46dc-a60c-676d8ac9b45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:38.300638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-bf12d18f-cf93-46dc-a60c-676d8ac9b45f None None] MFA Rules not processed for user `c81fde029db243a7935e3e90cef369e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:38.301910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bf12d18f-cf93-46dc-a60c-676d8ac9b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:38.313640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:38.377648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1328/2662] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:38.389406 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:38.395831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:38.456737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12d18f-cf93-46dc-a60c-676d8ac9b45f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:38.459081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bf12d18f-cf93-46dc-a60c-676d8ac9b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:38.476581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12d18f-cf93-46dc-a60c-676d8ac9b45f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:38.482005 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:38.482652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:38.482938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:38.483214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] PATH_INFO: `/v3/users/79ac3436d4c64aa697da8e9c2536491a` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:38.484569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ac3436d4c64aa697da8e9c2536491a)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:38.486585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:38.492416 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63080b9e-582f-4313-a155-5ee4d1ccf89d service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:38.498970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589ff1-eda0-4258-b3ef-dd0a43673189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:38.499636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589ff1-eda0-4258-b3ef-dd0a43673189 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:38.502394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589ff1-eda0-4258-b3ef-dd0a43673189 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:38.502394 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589ff1-eda0-4258-b3ef-dd0a43673189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:38.509192 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4589ff1-eda0-4258-b3ef-dd0a43673189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:38.510786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4589ff1-eda0-4258-b3ef-dd0a43673189 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:38.522228 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1335/2663] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:38.700102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ac3436d4c64aa697da8e9c2536491a'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:38.701189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ac3436d4c64aa697da8e9c2536491a'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:38.763649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ac3436d4c64aa697da8e9c2536491a'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:38.773449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ac3436d4c64aa697da8e9c2536491a'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:38.786799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ac3436d4c64aa697da8e9c2536491a'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:38.796889 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1329/2664] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:09:38 2022] DELETE /identity/v3/users/79ac3436d4c64aa697da8e9c2536491a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:09:38.798458 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278f2b-0e72-48c3-8561-0f71b97f8bb1 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:38.799132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278f2b-0e72-48c3-8561-0f71b97f8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:38.799132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278f2b-0e72-48c3-8561-0f71b97f8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:38.821211 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e4278f2b-0e72-48c3-8561-0f71b97f8bb1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:38.822443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e4278f2b-0e72-48c3-8561-0f71b97f8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:38.892128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1336/2665] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:09:38.903844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:38.905728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:38.977195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc099e2-71f5-410a-b9b4-cd1602a88bb9 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:38.981276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c569c4e-6e5e-4dd0-8ceb-424280520d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:38.982017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569c4e-6e5e-4dd0-8ceb-424280520d02 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:38.982299 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569c4e-6e5e-4dd0-8ceb-424280520d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:38.982569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569c4e-6e5e-4dd0-8ceb-424280520d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:38.997025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c569c4e-6e5e-4dd0-8ceb-424280520d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:38.998657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c569c4e-6e5e-4dd0-8ceb-424280520d02 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:39.012652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1330/2666] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:39.433363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278f2b-0e72-48c3-8561-0f71b97f8bb1 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:39.434972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e4278f2b-0e72-48c3-8561-0f71b97f8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:39.449586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278f2b-0e72-48c3-8561-0f71b97f8bb1 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:39.454342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:39.454978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:39.455280 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:39.456282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] PATH_INFO: `/v3/projects/ab9d54fbfd2a456f87296c3de15d3b5e` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:39.457926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab9d54fbfd2a456f87296c3de15d3b5e)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:39.460034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:39.606187 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:39.607614 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab9d54fbfd2a456f87296c3de15d3b5e', 'request_id': 'req-1104e50d-71e9-425c-a539-b515cfe26787'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:39.614074 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab9d54fbfd2a456f87296c3de15d3b5e', 'request_id': 'req-1104e50d-71e9-425c-a539-b515cfe26787'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:39.631858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab9d54fbfd2a456f87296c3de15d3b5e', 'request_id': 'req-1104e50d-71e9-425c-a539-b515cfe26787'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:39.712483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] The token cache is being invalidate because project ab9d54fbfd2a456f87296c3de15d3b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:09:39.712775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:39.717146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:39.717146 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1337/2667] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:09:39 2022] DELETE /identity/v3/projects/ab9d54fbfd2a456f87296c3de15d3b5e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:39.719084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c569c4e-6e5e-4dd0-8ceb-424280520d02 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:39.729666 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c569c4e-6e5e-4dd0-8ceb-424280520d02 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:39.765012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:39.805246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:39.805899 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:39.806173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:39.806494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] PATH_INFO: `/v3/users/d602efb8ceb045feb293081ade7d9b98` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:39.807754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d602efb8ceb045feb293081ade7d9b98)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:39.809784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:40.001426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd602efb8ceb045feb293081ade7d9b98'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.002143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd602efb8ceb045feb293081ade7d9b98'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.085310 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd602efb8ceb045feb293081ade7d9b98'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.094048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd602efb8ceb045feb293081ade7d9b98'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.110389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd602efb8ceb045feb293081ade7d9b98'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.119598 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1331/2668] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:09:39 2022] DELETE /identity/v3/users/d602efb8ceb045feb293081ade7d9b98 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:40.692088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:40.693684 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:40.707309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1104e50d-71e9-425c-a539-b515cfe26787 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:40.779823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:40.780683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:40.780875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:40.781334 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] PATH_INFO: `/v3/projects/13b96c8b95bf40ef8ddc69a63177ec57` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:40.783170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b96c8b95bf40ef8ddc69a63177ec57)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:40.785974 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:40.889892 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b96c8b95bf40ef8ddc69a63177ec57', 'request_id': 'req-ab3b225b-df82-420c-905a-5349e1263128'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.897514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b96c8b95bf40ef8ddc69a63177ec57', 'request_id': 'req-ab3b225b-df82-420c-905a-5349e1263128'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.904444 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b96c8b95bf40ef8ddc69a63177ec57', 'request_id': 'req-ab3b225b-df82-420c-905a-5349e1263128'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.965679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] The token cache is being invalidate because project 13b96c8b95bf40ef8ddc69a63177ec57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:09:40.965972 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.966625 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-ab3b225b-df82-420c-905a-5349e1263128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:40.968154 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1338/2669] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:09:40 2022] DELETE /identity/v3/projects/13b96c8b95bf40ef8ddc69a63177ec57 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:40.972423 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:40.973911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:40.987377 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94d3c5-d1be-4f82-893a-da276cd91335 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:41.066196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:41.066950 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:41.067245 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:41.067628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] PATH_INFO: `/v3/users/20d113baccb34ee195271c041f2fd7be` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:41.070546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d113baccb34ee195271c041f2fd7be)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:41.072095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:41.101894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc571eda-7d90-41f1-b3f5-d83abf2faf33 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:41.102598 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc571eda-7d90-41f1-b3f5-d83abf2faf33 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:41.103067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc571eda-7d90-41f1-b3f5-d83abf2faf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:41.125554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-bc571eda-7d90-41f1-b3f5-d83abf2faf33 None None] MFA Rules not processed for user `c81fde029db243a7935e3e90cef369e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:41.126961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bc571eda-7d90-41f1-b3f5-d83abf2faf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:41.202209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1339/2670] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:41.288573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d113baccb34ee195271c041f2fd7be'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:41.289420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d113baccb34ee195271c041f2fd7be'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:41.292367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:41.487949 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d113baccb34ee195271c041f2fd7be'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:41.499614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d113baccb34ee195271c041f2fd7be'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:41.513517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d113baccb34ee195271c041f2fd7be'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:41.521080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1332/2671] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:09:40 2022] DELETE /identity/v3/users/20d113baccb34ee195271c041f2fd7be => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:42.041486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc571eda-7d90-41f1-b3f5-d83abf2faf33 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:42.043460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-bc571eda-7d90-41f1-b3f5-d83abf2faf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:42.060583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc571eda-7d90-41f1-b3f5-d83abf2faf33 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:42.074038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:42.109953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:42.111545 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:42.150931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:42.154237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:42.154798 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:42.155291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] PATH_INFO: `/v3/projects/c34398df4719473aaf96444afda71808` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:42.157267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34398df4719473aaf96444afda71808)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:42.159977 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:42.216058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6d394-2039-4f10-aee5-fa8bcf141882 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:42.222231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917e2de-995a-4b7d-bcba-c6f8271768dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:42.223066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917e2de-995a-4b7d-bcba-c6f8271768dc service placement] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:42.223374 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917e2de-995a-4b7d-bcba-c6f8271768dc service placement] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:42.223644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917e2de-995a-4b7d-bcba-c6f8271768dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:42.225489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8917e2de-995a-4b7d-bcba-c6f8271768dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:42.242055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917e2de-995a-4b7d-bcba-c6f8271768dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:42.244655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917e2de-995a-4b7d-bcba-c6f8271768dc service placement] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:42.267490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1333/2672] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:09:42.306531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34398df4719473aaf96444afda71808', 'request_id': 'req-4c776027-af54-4e4b-9356-d8f79f332159'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:42.315469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34398df4719473aaf96444afda71808', 'request_id': 'req-4c776027-af54-4e4b-9356-d8f79f332159'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:42.324862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34398df4719473aaf96444afda71808', 'request_id': 'req-4c776027-af54-4e4b-9356-d8f79f332159'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:42.418681 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] The token cache is being invalidate because project c34398df4719473aaf96444afda71808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:09:42.418991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:42.419658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-4c776027-af54-4e4b-9356-d8f79f332159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:42.423272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1340/2673] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:09:42 2022] DELETE /identity/v3/projects/c34398df4719473aaf96444afda71808 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:42.426755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac47d2-19e8-4d5d-af26-2e6871aa424e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:42.427033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac47d2-19e8-4d5d-af26-2e6871aa424e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:42.427346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac47d2-19e8-4d5d-af26-2e6871aa424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:42.447383 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-15ac47d2-19e8-4d5d-af26-2e6871aa424e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:42.448584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-15ac47d2-19e8-4d5d-af26-2e6871aa424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:42.512675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1334/2674] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:42.517223 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4a40f-a136-4167-9fdb-7c7dedbb6af4 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:42.517507 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4a40f-a136-4167-9fdb-7c7dedbb6af4 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:42.517802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4a40f-a136-4167-9fdb-7c7dedbb6af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:42.539231 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-2ae4a40f-a136-4167-9fdb-7c7dedbb6af4 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:42.540451 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2ae4a40f-a136-4167-9fdb-7c7dedbb6af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:42.548722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1341/2675] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:42.553622 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac47d2-19e8-4d5d-af26-2e6871aa424e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:42.563377 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac47d2-19e8-4d5d-af26-2e6871aa424e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:42.567919 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062ff83-8aa5-4033-b4a9-fa8232346154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:42.568618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062ff83-8aa5-4033-b4a9-fa8232346154 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:42.569426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062ff83-8aa5-4033-b4a9-fa8232346154 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:42.569732 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062ff83-8aa5-4033-b4a9-fa8232346154 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:42.570327 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062ff83-8aa5-4033-b4a9-fa8232346154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:09:42.570624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062ff83-8aa5-4033-b4a9-fa8232346154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:42.572252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062ff83-8aa5-4033-b4a9-fa8232346154 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:42.583539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1335/2676] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:09:42.591783 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4a40f-a136-4167-9fdb-7c7dedbb6af4 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:42.601676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4a40f-a136-4167-9fdb-7c7dedbb6af4 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:42.606668 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882db8f-2022-434e-9820-5e23601f80c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:42.607289 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882db8f-2022-434e-9820-5e23601f80c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:42.607566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882db8f-2022-434e-9820-5e23601f80c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:42.607833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882db8f-2022-434e-9820-5e23601f80c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:42.608480 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882db8f-2022-434e-9820-5e23601f80c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:42.610346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882db8f-2022-434e-9820-5e23601f80c6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:42.690259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1342/2677] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:09:42 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:42.694912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062ff83-8aa5-4033-b4a9-fa8232346154 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:42.705149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062ff83-8aa5-4033-b4a9-fa8232346154 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:42.750367 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:42.766489 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2430b-c1e9-481b-a3f4-4200cce8a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:42.767101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2430b-c1e9-481b-a3f4-4200cce8a516 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:42.767412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2430b-c1e9-481b-a3f4-4200cce8a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:42.767680 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2430b-c1e9-481b-a3f4-4200cce8a516 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:42.768322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2430b-c1e9-481b-a3f4-4200cce8a516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:42.770253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2430b-c1e9-481b-a3f4-4200cce8a516 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:42.898971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1336/2678] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:09:42 2022] POST /identity/v3/users => generated 296 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:42.903363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882db8f-2022-434e-9820-5e23601f80c6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:42.914755 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882db8f-2022-434e-9820-5e23601f80c6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:42.920217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaa494-5e7f-4019-9bea-d509aac7600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:42.920831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaa494-5e7f-4019-9bea-d509aac7600c admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:42.921104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaa494-5e7f-4019-9bea-d509aac7600c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:42.921372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaa494-5e7f-4019-9bea-d509aac7600c admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:42.922016 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaa494-5e7f-4019-9bea-d509aac7600c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:42.923736 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaa494-5e7f-4019-9bea-d509aac7600c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:42.940813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1343/2679] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:09:42.946368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2430b-c1e9-481b-a3f4-4200cce8a516 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:42.956683 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2430b-c1e9-481b-a3f4-4200cce8a516 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:42.962281 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492a48a-d058-4923-a41d-e3361753732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:42.962932 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a48a-d058-4923-a41d-e3361753732f admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:42.963211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a48a-d058-4923-a41d-e3361753732f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:42.964883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a48a-d058-4923-a41d-e3361753732f admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:42.964883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492a48a-d058-4923-a41d-e3361753732f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:42.965744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492a48a-d058-4923-a41d-e3361753732f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:42.977326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1337/2680] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:42.981993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaa494-5e7f-4019-9bea-d509aac7600c admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:42.993245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaa494-5e7f-4019-9bea-d509aac7600c admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:43.000543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3058da7-8f2f-4f59-af30-49dd28c037a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:43.001329 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3058da7-8f2f-4f59-af30-49dd28c037a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:43.001481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3058da7-8f2f-4f59-af30-49dd28c037a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:43.001639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3058da7-8f2f-4f59-af30-49dd28c037a8 admin admin] PATH_INFO: `/v3/projects/3c48fd2ddf7444989c80295acb3d0e30/users/37896d1f7767450bb79ac83f913a8678/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:43.024725 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3058da7-8f2f-4f59-af30-49dd28c037a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c48fd2ddf7444989c80295acb3d0e30, user_id=37896d1f7767450bb79ac83f913a8678, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:43.027453 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3058da7-8f2f-4f59-af30-49dd28c037a8 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:43.136405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1344/2681] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:09:42 2022] PUT /identity/v3/projects/3c48fd2ddf7444989c80295acb3d0e30/users/37896d1f7767450bb79ac83f913a8678/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:43.149794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74d785-c2f7-430c-86e2-53183c39e410 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:43.150257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74d785-c2f7-430c-86e2-53183c39e410 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:43.150431 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74d785-c2f7-430c-86e2-53183c39e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:43.181421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-cd74d785-c2f7-430c-86e2-53183c39e410 None None] MFA Rules not processed for user `37896d1f7767450bb79ac83f913a8678`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:43.182882 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cd74d785-c2f7-430c-86e2-53183c39e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:43.251734 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1338/2682] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:43.256547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3058da7-8f2f-4f59-af30-49dd28c037a8 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:43.303469 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:43.324265 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3058da7-8f2f-4f59-af30-49dd28c037a8 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:43.328976 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57895e7-9adf-4217-96cd-11a5d0bd8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:43.329581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57895e7-9adf-4217-96cd-11a5d0bd8c60 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:43.329880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57895e7-9adf-4217-96cd-11a5d0bd8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:43.330148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57895e7-9adf-4217-96cd-11a5d0bd8c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:43.330802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57895e7-9adf-4217-96cd-11a5d0bd8c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:43.332760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57895e7-9adf-4217-96cd-11a5d0bd8c60 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:43.462008 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1345/2683] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:09:43 2022] POST /identity/v3/projects => generated 393 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:09:43.466157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74d785-c2f7-430c-86e2-53183c39e410 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:43.477313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74d785-c2f7-430c-86e2-53183c39e410 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:43.534707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add8547-75f9-42ba-9664-dbe9fc3ef8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:43.535364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8547-75f9-42ba-9664-dbe9fc3ef8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:43.535644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8547-75f9-42ba-9664-dbe9fc3ef8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:43.535913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add8547-75f9-42ba-9664-dbe9fc3ef8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:43.536660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add8547-75f9-42ba-9664-dbe9fc3ef8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:43.538875 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add8547-75f9-42ba-9664-dbe9fc3ef8d1 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:43.643301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1339/2684] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:09:43 2022] POST /identity/v3/users => generated 303 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:43.648233 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57895e7-9adf-4217-96cd-11a5d0bd8c60 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:43.660027 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57895e7-9adf-4217-96cd-11a5d0bd8c60 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:43.665460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf128be-8a35-406c-bf15-f881944c1ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:43.666087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf128be-8a35-406c-bf15-f881944c1ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:43.666366 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf128be-8a35-406c-bf15-f881944c1ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:43.666639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf128be-8a35-406c-bf15-f881944c1ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:43.667337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf128be-8a35-406c-bf15-f881944c1ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:43.669168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf128be-8a35-406c-bf15-f881944c1ea6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:43.681087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1346/2685] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:43.685477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add8547-75f9-42ba-9664-dbe9fc3ef8d1 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:43.698591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add8547-75f9-42ba-9664-dbe9fc3ef8d1 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:43.704808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95b437-9dd1-4485-b3e7-cb72f0fa37dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:43.705557 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b437-9dd1-4485-b3e7-cb72f0fa37dd admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:43.705927 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b437-9dd1-4485-b3e7-cb72f0fa37dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:43.706297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b437-9dd1-4485-b3e7-cb72f0fa37dd admin admin] PATH_INFO: `/v3/projects/cbc06394e0cc446cbc9a931a81aec07f/users/a7acbf9417544cf29f552a0bc3555bac/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:43.725672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95b437-9dd1-4485-b3e7-cb72f0fa37dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc06394e0cc446cbc9a931a81aec07f, user_id=a7acbf9417544cf29f552a0bc3555bac, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:43.729337 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95b437-9dd1-4485-b3e7-cb72f0fa37dd admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:43.813375 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1340/2686] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:09:43 2022] PUT /identity/v3/projects/cbc06394e0cc446cbc9a931a81aec07f/users/a7acbf9417544cf29f552a0bc3555bac/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:43.819813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf128be-8a35-406c-bf15-f881944c1ea6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:43.830219 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf128be-8a35-406c-bf15-f881944c1ea6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:43.904512 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b82bcb-9535-4553-b71f-0b334d6f8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:43.905239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b82bcb-9535-4553-b71f-0b334d6f8f3a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:43.906141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b82bcb-9535-4553-b71f-0b334d6f8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:43.908320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b82bcb-9535-4553-b71f-0b334d6f8f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:43.908320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b82bcb-9535-4553-b71f-0b334d6f8f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:43.909967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b82bcb-9535-4553-b71f-0b334d6f8f3a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:43.922190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1347/2687] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:43.926377 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95b437-9dd1-4485-b3e7-cb72f0fa37dd admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:43.937895 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95b437-9dd1-4485-b3e7-cb72f0fa37dd admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:43.942582 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4e27a-88ab-4ff8-a2b8-95a37443d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:43.943324 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4e27a-88ab-4ff8-a2b8-95a37443d59f admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:43.944297 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4e27a-88ab-4ff8-a2b8-95a37443d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:43.944600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4e27a-88ab-4ff8-a2b8-95a37443d59f admin admin] PATH_INFO: `/v3/projects/cbc06394e0cc446cbc9a931a81aec07f/users/a7acbf9417544cf29f552a0bc3555bac/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:43.946632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4e27a-88ab-4ff8-a2b8-95a37443d59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc06394e0cc446cbc9a931a81aec07f, user_id=a7acbf9417544cf29f552a0bc3555bac, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:43.949339 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4e27a-88ab-4ff8-a2b8-95a37443d59f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:43.960957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1341/2688] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:09:43 2022] PUT /identity/v3/projects/cbc06394e0cc446cbc9a931a81aec07f/users/a7acbf9417544cf29f552a0bc3555bac/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:43.971077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7e94-c226-4235-9322-e31e487e9ead None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:43.971399 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7e94-c226-4235-9322-e31e487e9ead None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:43.971716 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7e94-c226-4235-9322-e31e487e9ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:44.001425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fcdf7e94-c226-4235-9322-e31e487e9ead None None] MFA Rules not processed for user `a7acbf9417544cf29f552a0bc3555bac`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:44.002658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fcdf7e94-c226-4235-9322-e31e487e9ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:44.074181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1348/2689] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:44.085451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4e27a-88ab-4ff8-a2b8-95a37443d59f admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:44.087260 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-17f4e27a-88ab-4ff8-a2b8-95a37443d59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:44.092693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:44.161539 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4e27a-88ab-4ff8-a2b8-95a37443d59f admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:44.166101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da2368-1f70-4f9b-ae8c-2c6781e61f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:44.166738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da2368-1f70-4f9b-ae8c-2c6781e61f09 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:44.167013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da2368-1f70-4f9b-ae8c-2c6781e61f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:44.167311 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da2368-1f70-4f9b-ae8c-2c6781e61f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:44.177317 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da2368-1f70-4f9b-ae8c-2c6781e61f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:44.179650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da2368-1f70-4f9b-ae8c-2c6781e61f09 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:44.189574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1342/2690] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:44.240170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7e94-c226-4235-9322-e31e487e9ead None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:44.241816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fcdf7e94-c226-4235-9322-e31e487e9ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:44.254206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7e94-c226-4235-9322-e31e487e9ead None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:44.258841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009bf95-9928-4465-8e64-ef7f90ebea5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:44.259777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009bf95-9928-4465-8e64-ef7f90ebea5d service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:44.260116 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009bf95-9928-4465-8e64-ef7f90ebea5d service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:44.260310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009bf95-9928-4465-8e64-ef7f90ebea5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:44.294165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:44.323937 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009bf95-9928-4465-8e64-ef7f90ebea5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:44.325386 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009bf95-9928-4465-8e64-ef7f90ebea5d service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:44.336041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1349/2691] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:45.632465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da2368-1f70-4f9b-ae8c-2c6781e61f09 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:45.634309 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-05da2368-1f70-4f9b-ae8c-2c6781e61f09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:45.694252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da2368-1f70-4f9b-ae8c-2c6781e61f09 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:45.698082 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c71a5-7c7b-4019-b78a-5da17bce1cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:45.698700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c71a5-7c7b-4019-b78a-5da17bce1cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:45.698982 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c71a5-7c7b-4019-b78a-5da17bce1cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:45.699277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c71a5-7c7b-4019-b78a-5da17bce1cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:45.701285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7f1c71a5-7c7b-4019-b78a-5da17bce1cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:45.714758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c71a5-7c7b-4019-b78a-5da17bce1cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:45.716436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c71a5-7c7b-4019-b78a-5da17bce1cf1 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:45.726296 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1343/2692] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:46.514671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009bf95-9928-4465-8e64-ef7f90ebea5d service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:46.516639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-5009bf95-9928-4465-8e64-ef7f90ebea5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:46.612975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009bf95-9928-4465-8e64-ef7f90ebea5d service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:46.620417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269ba34-5291-4a9b-9610-69212b26bd28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:46.621094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ba34-5291-4a9b-9610-69212b26bd28 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:46.621374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ba34-5291-4a9b-9610-69212b26bd28 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:46.621646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269ba34-5291-4a9b-9610-69212b26bd28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:46.623690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7269ba34-5291-4a9b-9610-69212b26bd28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:46.638162 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269ba34-5291-4a9b-9610-69212b26bd28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:46.639596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269ba34-5291-4a9b-9610-69212b26bd28 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:46.664671 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1350/2693] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:09:49.132058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c71a5-7c7b-4019-b78a-5da17bce1cf1 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:49.213462 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c71a5-7c7b-4019-b78a-5da17bce1cf1 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:49.217978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:49.218624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:49.219569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:49.219947 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] PATH_INFO: `/v3/users/37896d1f7767450bb79ac83f913a8678` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:49.221210 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37896d1f7767450bb79ac83f913a8678)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:49.223214 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:49.476563 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37896d1f7767450bb79ac83f913a8678'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:49.477243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37896d1f7767450bb79ac83f913a8678'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:49.480247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:49.579111 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37896d1f7767450bb79ac83f913a8678'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:49.587604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37896d1f7767450bb79ac83f913a8678'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:49.600945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37896d1f7767450bb79ac83f913a8678'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:49.607466 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1344/2694] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:09:49 2022] DELETE /identity/v3/users/37896d1f7767450bb79ac83f913a8678 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:49.612237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a786fd-9fa7-423e-8877-3b14aa23eedc None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:49.612841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a786fd-9fa7-423e-8877-3b14aa23eedc None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:49.613084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a786fd-9fa7-423e-8877-3b14aa23eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:49.633215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b2a786fd-9fa7-423e-8877-3b14aa23eedc None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:49.635077 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b2a786fd-9fa7-423e-8877-3b14aa23eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:49.715741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1351/2695] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:49.722447 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:49.724221 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:49.789463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0a3d6-960b-404d-be4a-ef2e2052d590 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:49.793095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4697-f0ec-4e52-ab31-650809efe2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:49.793699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4697-f0ec-4e52-ab31-650809efe2ed service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:49.793975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4697-f0ec-4e52-ab31-650809efe2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:49.794252 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4697-f0ec-4e52-ab31-650809efe2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:49.804503 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d4697-f0ec-4e52-ab31-650809efe2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:49.806172 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d4697-f0ec-4e52-ab31-650809efe2ed service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:49.816037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1345/2696] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:50.286834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a786fd-9fa7-423e-8877-3b14aa23eedc None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:50.286834 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b2a786fd-9fa7-423e-8877-3b14aa23eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:50.304991 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a786fd-9fa7-423e-8877-3b14aa23eedc None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:50.316317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:50.318968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:50.318968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:50.318968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] PATH_INFO: `/v3/projects/3c48fd2ddf7444989c80295acb3d0e30` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:50.319602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c48fd2ddf7444989c80295acb3d0e30)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:50.321586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:50.462080 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c48fd2ddf7444989c80295acb3d0e30', 'request_id': 'req-53cb3fe7-b25b-4a63-b21f-d48106354455'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.464261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:50.468330 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c48fd2ddf7444989c80295acb3d0e30', 'request_id': 'req-53cb3fe7-b25b-4a63-b21f-d48106354455'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.475656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c48fd2ddf7444989c80295acb3d0e30', 'request_id': 'req-53cb3fe7-b25b-4a63-b21f-d48106354455'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.573967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] The token cache is being invalidate because project 3c48fd2ddf7444989c80295acb3d0e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:09:50.574315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.575069 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.576802 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1352/2697] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:09:50 2022] DELETE /identity/v3/projects/3c48fd2ddf7444989c80295acb3d0e30 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:50.581211 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4697-f0ec-4e52-ab31-650809efe2ed service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:50.592268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4697-f0ec-4e52-ab31-650809efe2ed service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:50.655322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:50.656015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:50.656221 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:50.656495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] PATH_INFO: `/v3/users/a7acbf9417544cf29f552a0bc3555bac` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:50.657628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7acbf9417544cf29f552a0bc3555bac)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:50.660803 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:50.868513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7acbf9417544cf29f552a0bc3555bac'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.869136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7acbf9417544cf29f552a0bc3555bac'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.942085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7acbf9417544cf29f552a0bc3555bac'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.949849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7acbf9417544cf29f552a0bc3555bac'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.957483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:50.963101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4bf443ae-0b07-4a64-a157-728720e9db38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7acbf9417544cf29f552a0bc3555bac'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:50.969471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1346/2698] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:09:50 2022] DELETE /identity/v3/users/a7acbf9417544cf29f552a0bc3555bac => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:51.367801 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:51.370062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:51.385332 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb3fe7-b25b-4a63-b21f-d48106354455 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:51.455655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:51.456306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:51.456588 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:51.456941 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] PATH_INFO: `/v3/projects/cbc06394e0cc446cbc9a931a81aec07f` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:51.458252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc06394e0cc446cbc9a931a81aec07f)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:51.460769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:51.573055 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc06394e0cc446cbc9a931a81aec07f', 'request_id': 'req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:51.578824 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc06394e0cc446cbc9a931a81aec07f', 'request_id': 'req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:51.586040 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc06394e0cc446cbc9a931a81aec07f', 'request_id': 'req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:51.673525 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] The token cache is being invalidate because project cbc06394e0cc446cbc9a931a81aec07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:09:51.673823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:51.674410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d0516685-ed3a-4dc2-a13c-308e7d7be6b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:51.676147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1353/2699] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:09:51 2022] DELETE /identity/v3/projects/cbc06394e0cc446cbc9a931a81aec07f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:09:51.681348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930aa5-5298-4ba3-84f5-8a601ba3863e None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:51.681881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930aa5-5298-4ba3-84f5-8a601ba3863e None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:51.681881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930aa5-5298-4ba3-84f5-8a601ba3863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:51.702646 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-fd930aa5-5298-4ba3-84f5-8a601ba3863e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:51.703893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-fd930aa5-5298-4ba3-84f5-8a601ba3863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:51.766132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1347/2700] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:51.776155 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cb9bd-5de0-4584-8fdb-471d41c3eb2a None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:51.776460 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cb9bd-5de0-4584-8fdb-471d41c3eb2a None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:51.776734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cb9bd-5de0-4584-8fdb-471d41c3eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:51.796823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e22cb9bd-5de0-4584-8fdb-471d41c3eb2a None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:51.798037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e22cb9bd-5de0-4584-8fdb-471d41c3eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:51.806437 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1354/2701] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:51.810981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd930aa5-5298-4ba3-84f5-8a601ba3863e None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:51.821841 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd930aa5-5298-4ba3-84f5-8a601ba3863e None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:51.826581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350e814-2026-4133-80c9-68b244600e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:51.827198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350e814-2026-4133-80c9-68b244600e23 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:51.827509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350e814-2026-4133-80c9-68b244600e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:51.827782 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350e814-2026-4133-80c9-68b244600e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:51.828439 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350e814-2026-4133-80c9-68b244600e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:09:51.828741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350e814-2026-4133-80c9-68b244600e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:51.830357 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350e814-2026-4133-80c9-68b244600e23 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:51.843199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1348/2702] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:09:51.847691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cb9bd-5de0-4584-8fdb-471d41c3eb2a None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:51.858645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cb9bd-5de0-4584-8fdb-471d41c3eb2a None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:51.863442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaf593-ef32-4417-8def-a77ece932455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:51.864056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaf593-ef32-4417-8def-a77ece932455 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:51.864337 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaf593-ef32-4417-8def-a77ece932455 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:51.864601 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaf593-ef32-4417-8def-a77ece932455 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:51.865232 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaf593-ef32-4417-8def-a77ece932455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:51.867353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaf593-ef32-4417-8def-a77ece932455 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:51.947748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1355/2703] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:09:51 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:09:51.951962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350e814-2026-4133-80c9-68b244600e23 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:51.962961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350e814-2026-4133-80c9-68b244600e23 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:52.020497 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170cf87-7a2b-460a-9c5f-815fcbcd02ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:52.021105 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170cf87-7a2b-460a-9c5f-815fcbcd02ad admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:52.021438 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170cf87-7a2b-460a-9c5f-815fcbcd02ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:52.021741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170cf87-7a2b-460a-9c5f-815fcbcd02ad admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:52.022380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170cf87-7a2b-460a-9c5f-815fcbcd02ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:52.024333 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170cf87-7a2b-460a-9c5f-815fcbcd02ad admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:52.109236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1349/2704] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:09:51 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:09:52.113307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaf593-ef32-4417-8def-a77ece932455 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:52.124657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaf593-ef32-4417-8def-a77ece932455 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:52.129312 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4096e-d95f-4b91-9478-e3f967199f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:52.129952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4096e-d95f-4b91-9478-e3f967199f6e admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:52.130226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4096e-d95f-4b91-9478-e3f967199f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:52.130492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4096e-d95f-4b91-9478-e3f967199f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:52.131247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4096e-d95f-4b91-9478-e3f967199f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:52.135340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4096e-d95f-4b91-9478-e3f967199f6e admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:52.143363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1356/2705] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:09:52.147742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170cf87-7a2b-460a-9c5f-815fcbcd02ad admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:52.157737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170cf87-7a2b-460a-9c5f-815fcbcd02ad admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:52.162580 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c41df-41b5-455c-9cbc-91d4727b6e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:52.163177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c41df-41b5-455c-9cbc-91d4727b6e4c admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:52.163480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c41df-41b5-455c-9cbc-91d4727b6e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:52.163745 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c41df-41b5-455c-9cbc-91d4727b6e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:52.164384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c41df-41b5-455c-9cbc-91d4727b6e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:52.165986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c41df-41b5-455c-9cbc-91d4727b6e4c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:52.176912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1350/2706] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:09:52.182032 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4096e-d95f-4b91-9478-e3f967199f6e admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:52.192389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4096e-d95f-4b91-9478-e3f967199f6e admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:52.198180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a11b5-8004-4d61-a656-21b53f5149ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:52.198763 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a11b5-8004-4d61-a656-21b53f5149ca admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:52.199037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a11b5-8004-4d61-a656-21b53f5149ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:52.199356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a11b5-8004-4d61-a656-21b53f5149ca admin admin] PATH_INFO: `/v3/projects/76f824c6a7054dc9a10dd2eaae4f346b/users/5a1c7116e0874bc5ba6dc4642c12a908/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:52.218098 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a11b5-8004-4d61-a656-21b53f5149ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f824c6a7054dc9a10dd2eaae4f346b, user_id=5a1c7116e0874bc5ba6dc4642c12a908, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:52.220517 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a11b5-8004-4d61-a656-21b53f5149ca admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:52.282732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1357/2707] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:09:52 2022] PUT /identity/v3/projects/76f824c6a7054dc9a10dd2eaae4f346b/users/5a1c7116e0874bc5ba6dc4642c12a908/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:09:52.293399 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075fcae-d22a-4f20-98d1-b1470fffe47a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:52.293684 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075fcae-d22a-4f20-98d1-b1470fffe47a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:52.293962 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075fcae-d22a-4f20-98d1-b1470fffe47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:52.324094 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-5075fcae-d22a-4f20-98d1-b1470fffe47a None None] MFA Rules not processed for user `5a1c7116e0874bc5ba6dc4642c12a908`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:52.325304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5075fcae-d22a-4f20-98d1-b1470fffe47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:52.374302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:52.397817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1351/2708] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:09:52.409646 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a11b5-8004-4d61-a656-21b53f5149ca admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:52.411539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1e7a11b5-8004-4d61-a656-21b53f5149ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:09:52.422943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:09:52.473114 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a11b5-8004-4d61-a656-21b53f5149ca admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:52.477820 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f177426-4d2f-4595-b9d5-4df1fccf121c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:52.482617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177426-4d2f-4595-b9d5-4df1fccf121c service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:52.482617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177426-4d2f-4595-b9d5-4df1fccf121c service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:52.482617 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177426-4d2f-4595-b9d5-4df1fccf121c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:52.488136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f177426-4d2f-4595-b9d5-4df1fccf121c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:52.489638 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f177426-4d2f-4595-b9d5-4df1fccf121c service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:52.501804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1358/2709] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:09:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:09:59.603788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075fcae-d22a-4f20-98d1-b1470fffe47a None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:09:59.668322 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075fcae-d22a-4f20-98d1-b1470fffe47a None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:09:59.672780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:09:59.673421 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:59.673700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:59.673972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] PATH_INFO: `/v3/users/5a1c7116e0874bc5ba6dc4642c12a908` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:59.675129 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1c7116e0874bc5ba6dc4642c12a908)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:09:59.677110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:09:59.874624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1c7116e0874bc5ba6dc4642c12a908'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:59.875420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1c7116e0874bc5ba6dc4642c12a908'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:59.931490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1c7116e0874bc5ba6dc4642c12a908'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:59.939569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1c7116e0874bc5ba6dc4642c12a908'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:59.953020 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1c7116e0874bc5ba6dc4642c12a908'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:09:59.959314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1352/2710] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:09:59 2022] DELETE /identity/v3/users/5a1c7116e0874bc5ba6dc4642c12a908 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:09:59.964906 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fd30-972a-4674-bd09-0e8b44ad1294 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:09:59.969926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fd30-972a-4674-bd09-0e8b44ad1294 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:09:59.969926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70fd30-972a-4674-bd09-0e8b44ad1294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:09:59.986667 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fa70fd30-972a-4674-bd09-0e8b44ad1294 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:09:59.987988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fa70fd30-972a-4674-bd09-0e8b44ad1294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:00.056579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1359/2711] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:00.066569 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:00.068409 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:00.131241 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f65ff-fda0-4d88-9d31-ae40f5c93da8 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:00.135473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8d0b7-ad03-4808-8e20-e33be7cf57e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:00.136126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d0b7-ad03-4808-8e20-e33be7cf57e7 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:00.136398 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d0b7-ad03-4808-8e20-e33be7cf57e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:00.136669 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d0b7-ad03-4808-8e20-e33be7cf57e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:00.148074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8d0b7-ad03-4808-8e20-e33be7cf57e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:00.149770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8d0b7-ad03-4808-8e20-e33be7cf57e7 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:00.160250 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1353/2712] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:10:00.630574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70fd30-972a-4674-bd09-0e8b44ad1294 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:00.632569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fa70fd30-972a-4674-bd09-0e8b44ad1294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:00.649835 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70fd30-972a-4674-bd09-0e8b44ad1294 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:00.654975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:00.655774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:00.656179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:00.656574 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] PATH_INFO: `/v3/projects/76f824c6a7054dc9a10dd2eaae4f346b` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:00.658005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f824c6a7054dc9a10dd2eaae4f346b)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:00.660152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:00.764103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f824c6a7054dc9a10dd2eaae4f346b', 'request_id': 'req-d24c98a8-aef9-4df5-b979-41fcf33bd763'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:00.770339 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f824c6a7054dc9a10dd2eaae4f346b', 'request_id': 'req-d24c98a8-aef9-4df5-b979-41fcf33bd763'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:00.778131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f824c6a7054dc9a10dd2eaae4f346b', 'request_id': 'req-d24c98a8-aef9-4df5-b979-41fcf33bd763'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:00.862271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] The token cache is being invalidate because project 76f824c6a7054dc9a10dd2eaae4f346b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:10:00.862555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:00.863201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d24c98a8-aef9-4df5-b979-41fcf33bd763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:00.864784 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1360/2713] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:10:00 2022] DELETE /identity/v3/projects/76f824c6a7054dc9a10dd2eaae4f346b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:00.870055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73056e-462e-47aa-8758-bc0af88f5902 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:00.870547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73056e-462e-47aa-8758-bc0af88f5902 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:00.870644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73056e-462e-47aa-8758-bc0af88f5902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:00.886072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:00.891957 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-3a73056e-462e-47aa-8758-bc0af88f5902 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:00.893205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3a73056e-462e-47aa-8758-bc0af88f5902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:00.960451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1354/2714] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:00.969699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f4a38-35cf-4928-9275-6b655a1f4b50 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:00.970273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f4a38-35cf-4928-9275-6b655a1f4b50 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:00.970273 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f4a38-35cf-4928-9275-6b655a1f4b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:00.992630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-207f4a38-35cf-4928-9275-6b655a1f4b50 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:00.994070 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-207f4a38-35cf-4928-9275-6b655a1f4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:01.002350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1361/2715] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:01.010902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73056e-462e-47aa-8758-bc0af88f5902 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:01.020787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73056e-462e-47aa-8758-bc0af88f5902 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:01.025831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e80a33-b4dd-475f-b7d3-fe6f6c547c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:01.026480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80a33-b4dd-475f-b7d3-fe6f6c547c7a admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:01.026758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80a33-b4dd-475f-b7d3-fe6f6c547c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:01.027032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e80a33-b4dd-475f-b7d3-fe6f6c547c7a admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:01.027728 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e80a33-b4dd-475f-b7d3-fe6f6c547c7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:10:01.028034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e80a33-b4dd-475f-b7d3-fe6f6c547c7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:01.029650 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e80a33-b4dd-475f-b7d3-fe6f6c547c7a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:01.042096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1355/2716] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:10:01.046724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f4a38-35cf-4928-9275-6b655a1f4b50 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:01.057414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f4a38-35cf-4928-9275-6b655a1f4b50 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:01.062256 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857533a-bef0-4479-8068-c403d02c7e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:01.062859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857533a-bef0-4479-8068-c403d02c7e33 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:01.063141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857533a-bef0-4479-8068-c403d02c7e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:01.063446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857533a-bef0-4479-8068-c403d02c7e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:01.064076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857533a-bef0-4479-8068-c403d02c7e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:01.066011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857533a-bef0-4479-8068-c403d02c7e33 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:01.199117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1362/2717] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:10:01 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:10:01.203623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e80a33-b4dd-475f-b7d3-fe6f6c547c7a admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:01.213699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e80a33-b4dd-475f-b7d3-fe6f6c547c7a admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:01.277014 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f17e-2b07-471f-95f2-d95fa587ddd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:01.277638 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f17e-2b07-471f-95f2-d95fa587ddd2 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:01.277918 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f17e-2b07-471f-95f2-d95fa587ddd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:01.278189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726f17e-2b07-471f-95f2-d95fa587ddd2 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:01.278835 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726f17e-2b07-471f-95f2-d95fa587ddd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:01.280833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726f17e-2b07-471f-95f2-d95fa587ddd2 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:01.379255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1356/2718] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:10:01 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:10:01.383692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857533a-bef0-4479-8068-c403d02c7e33 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:01.390713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:01.394956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857533a-bef0-4479-8068-c403d02c7e33 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:01.399954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69a94-8e5e-41a9-b1b2-0eb458c8c881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:01.400550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69a94-8e5e-41a9-b1b2-0eb458c8c881 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:01.400830 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69a94-8e5e-41a9-b1b2-0eb458c8c881 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:01.401101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69a94-8e5e-41a9-b1b2-0eb458c8c881 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:01.401747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da69a94-8e5e-41a9-b1b2-0eb458c8c881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:01.403383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da69a94-8e5e-41a9-b1b2-0eb458c8c881 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:01.414515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1363/2719] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:10:01.418698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f17e-2b07-471f-95f2-d95fa587ddd2 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:01.429200 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726f17e-2b07-471f-95f2-d95fa587ddd2 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:01.434364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154a842-7043-4cce-ae94-a3dc5bbe691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:01.434963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154a842-7043-4cce-ae94-a3dc5bbe691a admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:01.435262 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154a842-7043-4cce-ae94-a3dc5bbe691a admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:01.435564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154a842-7043-4cce-ae94-a3dc5bbe691a admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:01.436205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154a842-7043-4cce-ae94-a3dc5bbe691a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:01.437799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154a842-7043-4cce-ae94-a3dc5bbe691a admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:01.448777 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1357/2720] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:10:01.457165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69a94-8e5e-41a9-b1b2-0eb458c8c881 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:01.467844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69a94-8e5e-41a9-b1b2-0eb458c8c881 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:01.472379 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad7fdc-52d3-4c68-bb1d-2d7a0e46bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:01.473020 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7fdc-52d3-4c68-bb1d-2d7a0e46bfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:01.473292 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7fdc-52d3-4c68-bb1d-2d7a0e46bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:01.473559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7fdc-52d3-4c68-bb1d-2d7a0e46bfcd admin admin] PATH_INFO: `/v3/projects/1d461353338a467ab30f5ee73c469417/users/9dfe699a9e8b4af3babbf6342e5c274d/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:01.489657 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7fdc-52d3-4c68-bb1d-2d7a0e46bfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d461353338a467ab30f5ee73c469417, user_id=9dfe699a9e8b4af3babbf6342e5c274d, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:01.492946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7fdc-52d3-4c68-bb1d-2d7a0e46bfcd admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:01.574059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1364/2721] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:10:01 2022] PUT /identity/v3/projects/1d461353338a467ab30f5ee73c469417/users/9dfe699a9e8b4af3babbf6342e5c274d/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:10:01.640759 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6c651-8760-4e23-829e-a94b920cdb86 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:01.641035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6c651-8760-4e23-829e-a94b920cdb86 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:01.641302 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6c651-8760-4e23-829e-a94b920cdb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:01.671831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-84e6c651-8760-4e23-829e-a94b920cdb86 None None] MFA Rules not processed for user `9dfe699a9e8b4af3babbf6342e5c274d`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:01.673051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-84e6c651-8760-4e23-829e-a94b920cdb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:01.738871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1358/2722] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:10:01.750597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad7fdc-52d3-4c68-bb1d-2d7a0e46bfcd admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:01.752363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-58ad7fdc-52d3-4c68-bb1d-2d7a0e46bfcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:01.812963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad7fdc-52d3-4c68-bb1d-2d7a0e46bfcd admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:01.816721 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98636bf6-c76c-492b-a1b6-1fd25611129c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:01.817363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636bf6-c76c-492b-a1b6-1fd25611129c service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:01.817639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636bf6-c76c-492b-a1b6-1fd25611129c service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:01.817910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636bf6-c76c-492b-a1b6-1fd25611129c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:01.827373 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98636bf6-c76c-492b-a1b6-1fd25611129c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:01.828539 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98636bf6-c76c-492b-a1b6-1fd25611129c service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:01.837553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1365/2723] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:10:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:10:05.875268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6c651-8760-4e23-829e-a94b920cdb86 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:05.879414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:05.936888 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6c651-8760-4e23-829e-a94b920cdb86 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:05.941471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:05.942092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:05.942369 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:05.942641 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] PATH_INFO: `/v3/users/9dfe699a9e8b4af3babbf6342e5c274d` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:05.943785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfe699a9e8b4af3babbf6342e5c274d)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:05.945708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:06.104908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfe699a9e8b4af3babbf6342e5c274d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.105497 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfe699a9e8b4af3babbf6342e5c274d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.187558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfe699a9e8b4af3babbf6342e5c274d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.194788 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfe699a9e8b4af3babbf6342e5c274d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.207101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfe699a9e8b4af3babbf6342e5c274d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.213767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1359/2724] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:10:05 2022] DELETE /identity/v3/users/9dfe699a9e8b4af3babbf6342e5c274d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:06.218306 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c01f4-dc01-45b2-9a7c-e3937a14cb34 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:06.218767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c01f4-dc01-45b2-9a7c-e3937a14cb34 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:06.218889 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c01f4-dc01-45b2-9a7c-e3937a14cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:06.238346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-e17c01f4-dc01-45b2-9a7c-e3937a14cb34 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:06.239580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e17c01f4-dc01-45b2-9a7c-e3937a14cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:06.297402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1366/2725] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:06.307475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:06.309428 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:06.367176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a204fa3-d57c-4be8-9176-05de72e2f6a2 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:06.370871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606a2ed-58f9-4bf5-a46f-7bd7022d8bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:06.371506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606a2ed-58f9-4bf5-a46f-7bd7022d8bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:06.371784 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606a2ed-58f9-4bf5-a46f-7bd7022d8bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:06.372051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606a2ed-58f9-4bf5-a46f-7bd7022d8bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:06.380766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606a2ed-58f9-4bf5-a46f-7bd7022d8bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:06.382188 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606a2ed-58f9-4bf5-a46f-7bd7022d8bd4 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:06.392064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1360/2726] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:10:06.772380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c01f4-dc01-45b2-9a7c-e3937a14cb34 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:06.773841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-e17c01f4-dc01-45b2-9a7c-e3937a14cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:06.787112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c01f4-dc01-45b2-9a7c-e3937a14cb34 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:06.792230 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:06.792864 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:06.793141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:06.793409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] PATH_INFO: `/v3/projects/1d461353338a467ab30f5ee73c469417` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:06.794513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d461353338a467ab30f5ee73c469417)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:06.796610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:06.897318 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d461353338a467ab30f5ee73c469417', 'request_id': 'req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.903596 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d461353338a467ab30f5ee73c469417', 'request_id': 'req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.909759 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d461353338a467ab30f5ee73c469417', 'request_id': 'req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.913311 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:06.972459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] The token cache is being invalidate because project 1d461353338a467ab30f5ee73c469417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:10:06.972746 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.973363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-dee2df56-7b47-4a26-bc94-0f1c2c367b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:06.974994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1367/2727] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:10:06 2022] DELETE /identity/v3/projects/1d461353338a467ab30f5ee73c469417 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:06.980312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53572bd4-777a-4225-8e98-dbeef6631064 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:06.980815 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53572bd4-777a-4225-8e98-dbeef6631064 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:06.980911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53572bd4-777a-4225-8e98-dbeef6631064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.000675 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-53572bd4-777a-4225-8e98-dbeef6631064 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:07.001886 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-53572bd4-777a-4225-8e98-dbeef6631064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:07.021008 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:07.061204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1361/2728] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:07.068902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20d96-bce6-4e3a-9ab5-4bbd54ca2a1e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:07.069274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20d96-bce6-4e3a-9ab5-4bbd54ca2a1e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:07.069457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab20d96-bce6-4e3a-9ab5-4bbd54ca2a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.089567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-fab20d96-bce6-4e3a-9ab5-4bbd54ca2a1e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:07.090765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fab20d96-bce6-4e3a-9ab5-4bbd54ca2a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:07.099434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1368/2729] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:07.104236 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53572bd4-777a-4225-8e98-dbeef6631064 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:07.113780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53572bd4-777a-4225-8e98-dbeef6631064 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:07.119494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120f47d-aa6c-451c-a85f-996a0b7530cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:07.120079 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120f47d-aa6c-451c-a85f-996a0b7530cd admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:07.120351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120f47d-aa6c-451c-a85f-996a0b7530cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:07.120617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120f47d-aa6c-451c-a85f-996a0b7530cd admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.121254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120f47d-aa6c-451c-a85f-996a0b7530cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:10:07.121546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120f47d-aa6c-451c-a85f-996a0b7530cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:07.123125 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120f47d-aa6c-451c-a85f-996a0b7530cd admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:07.134826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1362/2730] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:10:07.138969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20d96-bce6-4e3a-9ab5-4bbd54ca2a1e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:07.148584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab20d96-bce6-4e3a-9ab5-4bbd54ca2a1e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:07.153628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce295c-aae8-4374-b21c-48377c5a064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:07.154220 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce295c-aae8-4374-b21c-48377c5a064a admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:07.154514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce295c-aae8-4374-b21c-48377c5a064a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:07.154790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce295c-aae8-4374-b21c-48377c5a064a admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.155450 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce295c-aae8-4374-b21c-48377c5a064a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:07.157349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce295c-aae8-4374-b21c-48377c5a064a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:07.269850 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1369/2731] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:10:07 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:10:07.274585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120f47d-aa6c-451c-a85f-996a0b7530cd admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:07.285083 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120f47d-aa6c-451c-a85f-996a0b7530cd admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:07.342846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ad551-f7af-4ec5-a8a1-c39285ccd33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:07.343508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ad551-f7af-4ec5-a8a1-c39285ccd33e admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:07.343790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ad551-f7af-4ec5-a8a1-c39285ccd33e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:07.344062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ad551-f7af-4ec5-a8a1-c39285ccd33e admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.344685 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ad551-f7af-4ec5-a8a1-c39285ccd33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:07.346647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ad551-f7af-4ec5-a8a1-c39285ccd33e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:07.456395 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1363/2732] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:10:07 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:10:07.469282 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce295c-aae8-4374-b21c-48377c5a064a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:07.480572 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce295c-aae8-4374-b21c-48377c5a064a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:07.485140 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eefec-b8e1-4cb3-a857-5210ea34413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:07.485731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eefec-b8e1-4cb3-a857-5210ea34413d admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:07.486007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eefec-b8e1-4cb3-a857-5210ea34413d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:07.486274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eefec-b8e1-4cb3-a857-5210ea34413d admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.486915 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eefec-b8e1-4cb3-a857-5210ea34413d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:07.488573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eefec-b8e1-4cb3-a857-5210ea34413d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:07.498573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1370/2733] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:10:07.502514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ad551-f7af-4ec5-a8a1-c39285ccd33e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:07.513133 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ad551-f7af-4ec5-a8a1-c39285ccd33e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:07.517743 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d934be6-f77c-4161-a71f-bebae6969b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:07.518331 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934be6-f77c-4161-a71f-bebae6969b3f admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:07.518604 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934be6-f77c-4161-a71f-bebae6969b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:07.518972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d934be6-f77c-4161-a71f-bebae6969b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.519579 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d934be6-f77c-4161-a71f-bebae6969b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:07.521155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d934be6-f77c-4161-a71f-bebae6969b3f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:07.532575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1364/2734] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:10:07.536814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eefec-b8e1-4cb3-a857-5210ea34413d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:07.547017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eefec-b8e1-4cb3-a857-5210ea34413d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:07.551870 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0f29-68a1-4f53-88ec-c26bb33ae5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:07.555652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0f29-68a1-4f53-88ec-c26bb33ae5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:07.555652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0f29-68a1-4f53-88ec-c26bb33ae5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:07.555652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df0f29-68a1-4f53-88ec-c26bb33ae5bf admin admin] PATH_INFO: `/v3/projects/e8484523c6724d03aef2df6d521178b4/users/462f4a54efbb451fa444e820efcb139e/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.567938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df0f29-68a1-4f53-88ec-c26bb33ae5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8484523c6724d03aef2df6d521178b4, user_id=462f4a54efbb451fa444e820efcb139e, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:07.570659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df0f29-68a1-4f53-88ec-c26bb33ae5bf admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:07.656629 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1371/2735] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:10:07 2022] PUT /identity/v3/projects/e8484523c6724d03aef2df6d521178b4/users/462f4a54efbb451fa444e820efcb139e/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:07.671365 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7f43c-3996-42a3-96c8-b6215b927ec8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:07.671651 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7f43c-3996-42a3-96c8-b6215b927ec8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:07.671924 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7f43c-3996-42a3-96c8-b6215b927ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.700509 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-40e7f43c-3996-42a3-96c8-b6215b927ec8 None None] MFA Rules not processed for user `462f4a54efbb451fa444e820efcb139e`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:07.701700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-40e7f43c-3996-42a3-96c8-b6215b927ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:07.765590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1365/2736] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:07.769861 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0f29-68a1-4f53-88ec-c26bb33ae5bf admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:07.831121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df0f29-68a1-4f53-88ec-c26bb33ae5bf admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:07.835732 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4388ab-041c-413e-b602-06717359f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:07.836327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4388ab-041c-413e-b602-06717359f345 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:07.836599 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4388ab-041c-413e-b602-06717359f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:07.836865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4388ab-041c-413e-b602-06717359f345 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:07.837483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4388ab-041c-413e-b602-06717359f345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:07.839613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4388ab-041c-413e-b602-06717359f345 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:07.928072 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1372/2737] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:10:07 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:10:07.932655 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7f43c-3996-42a3-96c8-b6215b927ec8 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:07.943792 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7f43c-3996-42a3-96c8-b6215b927ec8 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:07.960978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:08.003099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6755e7-13d7-42a6-9907-613323c5581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.003795 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6755e7-13d7-42a6-9907-613323c5581c admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.003903 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6755e7-13d7-42a6-9907-613323c5581c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.004173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6755e7-13d7-42a6-9907-613323c5581c admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.004806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6755e7-13d7-42a6-9907-613323c5581c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.006776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6755e7-13d7-42a6-9907-613323c5581c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.081465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1366/2738] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:10:07 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:10:08.085418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4388ab-041c-413e-b602-06717359f345 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:08.097035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4388ab-041c-413e-b602-06717359f345 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:08.101856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5376a9-3909-44a9-bbd5-841baa26804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.102449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5376a9-3909-44a9-bbd5-841baa26804b admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.102747 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5376a9-3909-44a9-bbd5-841baa26804b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.103003 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5376a9-3909-44a9-bbd5-841baa26804b admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.103680 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5376a9-3909-44a9-bbd5-841baa26804b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.107925 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5376a9-3909-44a9-bbd5-841baa26804b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.116181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1373/2739] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:10:08.120559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6755e7-13d7-42a6-9907-613323c5581c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:08.130644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6755e7-13d7-42a6-9907-613323c5581c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:08.135761 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c85eb-04c7-49b1-98ab-6a1480500815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.136616 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c85eb-04c7-49b1-98ab-6a1480500815 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.136717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c85eb-04c7-49b1-98ab-6a1480500815 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.136935 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c85eb-04c7-49b1-98ab-6a1480500815 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.137576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c85eb-04c7-49b1-98ab-6a1480500815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.139180 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c85eb-04c7-49b1-98ab-6a1480500815 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.149267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1367/2740] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:10:08.153999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5376a9-3909-44a9-bbd5-841baa26804b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:08.163949 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5376a9-3909-44a9-bbd5-841baa26804b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:08.168988 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad2a22-99b0-4546-acde-b5f1b96d4ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.169632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2a22-99b0-4546-acde-b5f1b96d4ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.169910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2a22-99b0-4546-acde-b5f1b96d4ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.170181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad2a22-99b0-4546-acde-b5f1b96d4ab6 admin admin] PATH_INFO: `/v3/projects/90462fc379814d1e89b5687026636b22/users/67bb24193e2e41788b4122df2d198a44/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.185049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad2a22-99b0-4546-acde-b5f1b96d4ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90462fc379814d1e89b5687026636b22, user_id=67bb24193e2e41788b4122df2d198a44, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.187776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad2a22-99b0-4546-acde-b5f1b96d4ab6 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.291398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1374/2741] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:10:08 2022] PUT /identity/v3/projects/90462fc379814d1e89b5687026636b22/users/67bb24193e2e41788b4122df2d198a44/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:08.301623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe7aa-5d6c-4b11-abeb-d8b52d2eac43 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.301913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe7aa-5d6c-4b11-abeb-d8b52d2eac43 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.302190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe7aa-5d6c-4b11-abeb-d8b52d2eac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.331606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-360fe7aa-5d6c-4b11-abeb-d8b52d2eac43 None None] MFA Rules not processed for user `67bb24193e2e41788b4122df2d198a44`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:08.332812 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-360fe7aa-5d6c-4b11-abeb-d8b52d2eac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:08.397073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1368/2742] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:08.401831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad2a22-99b0-4546-acde-b5f1b96d4ab6 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:08.446384 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:08.463025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad2a22-99b0-4546-acde-b5f1b96d4ab6 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:08.468690 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cec03-201c-4ace-b85e-53269a15642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.469288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cec03-201c-4ace-b85e-53269a15642a admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.469567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cec03-201c-4ace-b85e-53269a15642a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.469838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cec03-201c-4ace-b85e-53269a15642a admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.470496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cec03-201c-4ace-b85e-53269a15642a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.472534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cec03-201c-4ace-b85e-53269a15642a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.560268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1375/2743] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:10:08 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:10:08.564318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe7aa-5d6c-4b11-abeb-d8b52d2eac43 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:08.575102 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe7aa-5d6c-4b11-abeb-d8b52d2eac43 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:08.630099 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf58c2e-4c35-441f-be9e-33a5433963c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.630692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf58c2e-4c35-441f-be9e-33a5433963c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.630968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf58c2e-4c35-441f-be9e-33a5433963c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.631261 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf58c2e-4c35-441f-be9e-33a5433963c6 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.631883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf58c2e-4c35-441f-be9e-33a5433963c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.633789 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf58c2e-4c35-441f-be9e-33a5433963c6 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.734052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1369/2744] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:10:08 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:10:08.738513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cec03-201c-4ace-b85e-53269a15642a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:08.749138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cec03-201c-4ace-b85e-53269a15642a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:08.753777 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482249-9531-475a-ab7a-a56ee52c7824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.754372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482249-9531-475a-ab7a-a56ee52c7824 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.754651 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482249-9531-475a-ab7a-a56ee52c7824 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.754922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482249-9531-475a-ab7a-a56ee52c7824 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.755723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80482249-9531-475a-ab7a-a56ee52c7824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.757303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80482249-9531-475a-ab7a-a56ee52c7824 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.767979 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1376/2745] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:10:08.772052 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf58c2e-4c35-441f-be9e-33a5433963c6 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:08.782611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf58c2e-4c35-441f-be9e-33a5433963c6 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:08.787253 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa0722-a24e-410d-8ef6-7e8f2f9d12d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.787907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa0722-a24e-410d-8ef6-7e8f2f9d12d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.788187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa0722-a24e-410d-8ef6-7e8f2f9d12d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.788460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa0722-a24e-410d-8ef6-7e8f2f9d12d2 admin admin] PATH_INFO: `/v3/projects/60927160fbd54087907ca96ec9f450e3/users/fb4b9fc6bf5446948eaa039f1129dd31/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.802987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa0722-a24e-410d-8ef6-7e8f2f9d12d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60927160fbd54087907ca96ec9f450e3, user_id=fb4b9fc6bf5446948eaa039f1129dd31, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.805727 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa0722-a24e-410d-8ef6-7e8f2f9d12d2 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.807986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:08.874225 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1370/2746] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:10:08 2022] PUT /identity/v3/projects/60927160fbd54087907ca96ec9f450e3/users/fb4b9fc6bf5446948eaa039f1129dd31/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:08.878153 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482249-9531-475a-ab7a-a56ee52c7824 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:08.888152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482249-9531-475a-ab7a-a56ee52c7824 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:08.943675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d1c2c-77e2-41c1-bf16-ec4c8182f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.944268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d1c2c-77e2-41c1-bf16-ec4c8182f1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.944545 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d1c2c-77e2-41c1-bf16-ec4c8182f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.944812 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d1c2c-77e2-41c1-bf16-ec4c8182f1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.945442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d1c2c-77e2-41c1-bf16-ec4c8182f1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.947031 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d1c2c-77e2-41c1-bf16-ec4c8182f1a1 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.956710 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1377/2747] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:10:08.960901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa0722-a24e-410d-8ef6-7e8f2f9d12d2 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:08.971368 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa0722-a24e-410d-8ef6-7e8f2f9d12d2 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:08.975936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5a6c3-45e8-4b57-9d86-ecb1cfee5da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:08.976577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5a6c3-45e8-4b57-9d86-ecb1cfee5da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:08.976852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5a6c3-45e8-4b57-9d86-ecb1cfee5da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:08.977121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5a6c3-45e8-4b57-9d86-ecb1cfee5da6 admin admin] PATH_INFO: `/v3/projects/60927160fbd54087907ca96ec9f450e3/users/fb4b9fc6bf5446948eaa039f1129dd31/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:08.979612 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5a6c3-45e8-4b57-9d86-ecb1cfee5da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60927160fbd54087907ca96ec9f450e3, user_id=fb4b9fc6bf5446948eaa039f1129dd31, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:08.982390 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5a6c3-45e8-4b57-9d86-ecb1cfee5da6 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:08.992576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1371/2748] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:10:08 2022] PUT /identity/v3/projects/60927160fbd54087907ca96ec9f450e3/users/fb4b9fc6bf5446948eaa039f1129dd31/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:09.003447 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a383ba8-2f65-4968-80ef-97ddf635c594 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:09.003735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a383ba8-2f65-4968-80ef-97ddf635c594 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:09.004010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a383ba8-2f65-4968-80ef-97ddf635c594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:09.031375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7a383ba8-2f65-4968-80ef-97ddf635c594 None None] MFA Rules not processed for user `fb4b9fc6bf5446948eaa039f1129dd31`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:09.032578 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7a383ba8-2f65-4968-80ef-97ddf635c594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:09.099505 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1378/2749] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:09.111446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5a6c3-45e8-4b57-9d86-ecb1cfee5da6 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:09.113182 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c8a5a6c3-45e8-4b57-9d86-ecb1cfee5da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:09.173471 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5a6c3-45e8-4b57-9d86-ecb1cfee5da6 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:09.177169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ee20d-fd02-4d0e-a3dd-5d293af94336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:09.177766 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ee20d-fd02-4d0e-a3dd-5d293af94336 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:09.178065 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ee20d-fd02-4d0e-a3dd-5d293af94336 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:09.178335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ee20d-fd02-4d0e-a3dd-5d293af94336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:09.234362 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ee20d-fd02-4d0e-a3dd-5d293af94336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:09.235868 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ee20d-fd02-4d0e-a3dd-5d293af94336 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:09.244560 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1372/2750] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:10:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:10:11.177461 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a383ba8-2f65-4968-80ef-97ddf635c594 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:11.178862 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7a383ba8-2f65-4968-80ef-97ddf635c594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:11.191958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a383ba8-2f65-4968-80ef-97ddf635c594 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:11.195474 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28add72-75c0-4132-8855-136047c5c3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:11.196067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28add72-75c0-4132-8855-136047c5c3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:11.196344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28add72-75c0-4132-8855-136047c5c3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:11.196612 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28add72-75c0-4132-8855-136047c5c3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:11.231645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:11.255357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28add72-75c0-4132-8855-136047c5c3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:11.256856 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28add72-75c0-4132-8855-136047c5c3a6 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:11.266286 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1379/2751] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:10:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:10:12.682906 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ee20d-fd02-4d0e-a3dd-5d293af94336 service cinder] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:12.692012 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ee20d-fd02-4d0e-a3dd-5d293af94336 service cinder] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:12.695736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e65a64-f6ef-4ff7-bdc5-183c9cc1c002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:12.696414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e65a64-f6ef-4ff7-bdc5-183c9cc1c002 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:12.696698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e65a64-f6ef-4ff7-bdc5-183c9cc1c002 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:12.697037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e65a64-f6ef-4ff7-bdc5-183c9cc1c002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:12.707350 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e65a64-f6ef-4ff7-bdc5-183c9cc1c002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:12.708796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e65a64-f6ef-4ff7-bdc5-183c9cc1c002 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:12.719863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1373/2752] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:10:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:10:17.406815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28add72-75c0-4132-8855-136047c5c3a6 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:17.468977 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28add72-75c0-4132-8855-136047c5c3a6 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:17.473488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:17.474104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:17.474383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:17.474656 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] PATH_INFO: `/v3/users/462f4a54efbb451fa444e820efcb139e` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:17.475800 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=462f4a54efbb451fa444e820efcb139e)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:17.477734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:17.642936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462f4a54efbb451fa444e820efcb139e'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:17.643602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462f4a54efbb451fa444e820efcb139e'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:17.651117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462f4a54efbb451fa444e820efcb139e'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:17.726826 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462f4a54efbb451fa444e820efcb139e'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:17.740092 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462f4a54efbb451fa444e820efcb139e'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:17.746821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1380/2753] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:10:17 2022] DELETE /identity/v3/users/462f4a54efbb451fa444e820efcb139e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:17.751504 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4cc79-85b9-4481-a292-58356053beca None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:17.751960 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4cc79-85b9-4481-a292-58356053beca None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:17.752058 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4cc79-85b9-4481-a292-58356053beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:17.770417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f5e4cc79-85b9-4481-a292-58356053beca None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:17.771644 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f5e4cc79-85b9-4481-a292-58356053beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:17.829358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1374/2754] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:17.839099 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:17.840569 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:17.897886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa45973-0214-4742-bcfb-e777230df083 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:17.901433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8549e-8bba-436c-91bf-4d9f36abe7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:17.902019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8549e-8bba-436c-91bf-4d9f36abe7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:17.902291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8549e-8bba-436c-91bf-4d9f36abe7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:17.902554 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8549e-8bba-436c-91bf-4d9f36abe7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:17.911369 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8549e-8bba-436c-91bf-4d9f36abe7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:17.912788 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8549e-8bba-436c-91bf-4d9f36abe7c0 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:17.917170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:17.923062 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1381/2755] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:10:18.378581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4cc79-85b9-4481-a292-58356053beca None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:18.380089 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f5e4cc79-85b9-4481-a292-58356053beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:18.392810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4cc79-85b9-4481-a292-58356053beca None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:18.397535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:18.398272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:18.398440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:18.398699 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] PATH_INFO: `/v3/projects/e8484523c6724d03aef2df6d521178b4` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:18.399842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8484523c6724d03aef2df6d521178b4)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:18.402593 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:18.425817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:18.516016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8484523c6724d03aef2df6d521178b4', 'request_id': 'req-90b37fc6-6876-46e0-8b8d-d24afb4660da'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.522231 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8484523c6724d03aef2df6d521178b4', 'request_id': 'req-90b37fc6-6876-46e0-8b8d-d24afb4660da'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.590057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8484523c6724d03aef2df6d521178b4', 'request_id': 'req-90b37fc6-6876-46e0-8b8d-d24afb4660da'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.600654 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] The token cache is being invalidate because project e8484523c6724d03aef2df6d521178b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:10:18.600937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.601571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.603045 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1375/2756] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:10:18 2022] DELETE /identity/v3/projects/e8484523c6724d03aef2df6d521178b4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:18.607542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8549e-8bba-436c-91bf-4d9f36abe7c0 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:18.617290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8549e-8bba-436c-91bf-4d9f36abe7c0 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:18.673305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:18.673927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:18.674228 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:18.674497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] PATH_INFO: `/v3/users/67bb24193e2e41788b4122df2d198a44` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:18.675691 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bb24193e2e41788b4122df2d198a44)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:18.681113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:18.860255 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bb24193e2e41788b4122df2d198a44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.860962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bb24193e2e41788b4122df2d198a44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.867796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bb24193e2e41788b4122df2d198a44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.938443 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bb24193e2e41788b4122df2d198a44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.951041 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bb24193e2e41788b4122df2d198a44'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:18.956848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1382/2757] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:10:18 2022] DELETE /identity/v3/users/67bb24193e2e41788b4122df2d198a44 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:19.400508 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:19.402004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:19.415380 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b37fc6-6876-46e0-8b8d-d24afb4660da admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:19.474780 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:19.475400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:19.475681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:19.475978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] PATH_INFO: `/v3/projects/90462fc379814d1e89b5687026636b22` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:19.477112 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90462fc379814d1e89b5687026636b22)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:19.479338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:19.576017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90462fc379814d1e89b5687026636b22', 'request_id': 'req-a6742981-babd-49c9-bb14-3de078cef8f8'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:19.582029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90462fc379814d1e89b5687026636b22', 'request_id': 'req-a6742981-babd-49c9-bb14-3de078cef8f8'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:19.644285 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90462fc379814d1e89b5687026636b22', 'request_id': 'req-a6742981-babd-49c9-bb14-3de078cef8f8'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:19.654864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] The token cache is being invalidate because project 90462fc379814d1e89b5687026636b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:10:19.655149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:19.655801 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:19.657288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1376/2758] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:10:19 2022] DELETE /identity/v3/projects/90462fc379814d1e89b5687026636b22 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:19.661308 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:19.662686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:19.675186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e5ee0-3f6c-4149-85b7-37aa40e62605 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:19.733603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:19.734206 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:19.734481 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:19.734750 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] PATH_INFO: `/v3/users/fb4b9fc6bf5446948eaa039f1129dd31` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:19.735880 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4b9fc6bf5446948eaa039f1129dd31)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:19.737837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:19.758841 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:19.944345 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4b9fc6bf5446948eaa039f1129dd31'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:19.944993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4b9fc6bf5446948eaa039f1129dd31'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:19.952660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4b9fc6bf5446948eaa039f1129dd31'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:20.033274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4b9fc6bf5446948eaa039f1129dd31'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:20.046447 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-faf11b75-08b3-4ca6-877f-72e8a7132f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4b9fc6bf5446948eaa039f1129dd31'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:20.052427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1383/2759] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:10:19 2022] DELETE /identity/v3/users/fb4b9fc6bf5446948eaa039f1129dd31 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:20.458480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:20.460038 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:20.472853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6742981-babd-49c9-bb14-3de078cef8f8 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:20.506097 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:20.530770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:20.531437 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:20.531719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:20.531989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] PATH_INFO: `/v3/projects/60927160fbd54087907ca96ec9f450e3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:20.533195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=60927160fbd54087907ca96ec9f450e3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:20.535141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:20.662925 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60927160fbd54087907ca96ec9f450e3', 'request_id': 'req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:20.669819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60927160fbd54087907ca96ec9f450e3', 'request_id': 'req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:20.724206 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60927160fbd54087907ca96ec9f450e3', 'request_id': 'req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:20.735420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] The token cache is being invalidate because project 60927160fbd54087907ca96ec9f450e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:10:20.738945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:20.738945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3cb0d6a0-ed80-4497-a5b4-1846459dd3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:20.738945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1377/2760] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:10:20 2022] DELETE /identity/v3/projects/60927160fbd54087907ca96ec9f450e3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:20.742823 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2c79-ae94-4398-b3ce-1df8cc66d489 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:20.743323 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2c79-ae94-4398-b3ce-1df8cc66d489 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:20.743427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2c79-ae94-4398-b3ce-1df8cc66d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:20.763847 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ae7a2c79-ae94-4398-b3ce-1df8cc66d489 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:20.765057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ae7a2c79-ae94-4398-b3ce-1df8cc66d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:20.823806 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1384/2761] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:20.832270 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b03392-5692-447b-bafd-79028b95f196 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:20.832552 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b03392-5692-447b-bafd-79028b95f196 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:20.832819 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b03392-5692-447b-bafd-79028b95f196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:20.852645 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c4b03392-5692-447b-bafd-79028b95f196 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:20.854096 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c4b03392-5692-447b-bafd-79028b95f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:20.862000 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1378/2762] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:20.866188 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a2c79-ae94-4398-b3ce-1df8cc66d489 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:20.876000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a2c79-ae94-4398-b3ce-1df8cc66d489 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:20.880490 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac35bf-85df-434e-9902-3d2c47d32c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:20.881078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac35bf-85df-434e-9902-3d2c47d32c59 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:20.881353 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac35bf-85df-434e-9902-3d2c47d32c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:20.881620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac35bf-85df-434e-9902-3d2c47d32c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:20.882266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac35bf-85df-434e-9902-3d2c47d32c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:10:20.882557 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac35bf-85df-434e-9902-3d2c47d32c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:20.884177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac35bf-85df-434e-9902-3d2c47d32c59 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:20.895986 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1385/2763] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:10:20.900301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b03392-5692-447b-bafd-79028b95f196 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:20.910242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b03392-5692-447b-bafd-79028b95f196 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:20.914811 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791f61d-15ba-41d2-aa84-4b5d8195c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:20.915364 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791f61d-15ba-41d2-aa84-4b5d8195c460 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:20.915639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791f61d-15ba-41d2-aa84-4b5d8195c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:20.915905 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791f61d-15ba-41d2-aa84-4b5d8195c460 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:20.916537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791f61d-15ba-41d2-aa84-4b5d8195c460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:20.918640 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791f61d-15ba-41d2-aa84-4b5d8195c460 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:21.010806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1379/2764] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:10:20 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:10:21.016706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac35bf-85df-434e-9902-3d2c47d32c59 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:21.026697 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac35bf-85df-434e-9902-3d2c47d32c59 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:21.082607 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba1a05-274e-4d86-bb11-bdbaecd02d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:21.083203 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba1a05-274e-4d86-bb11-bdbaecd02d10 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:21.083511 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba1a05-274e-4d86-bb11-bdbaecd02d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:21.083782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba1a05-274e-4d86-bb11-bdbaecd02d10 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:21.084404 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba1a05-274e-4d86-bb11-bdbaecd02d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:21.086372 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba1a05-274e-4d86-bb11-bdbaecd02d10 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:21.158654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1386/2765] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:10:21 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:10:21.163078 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791f61d-15ba-41d2-aa84-4b5d8195c460 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:21.173866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791f61d-15ba-41d2-aa84-4b5d8195c460 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:21.178581 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42a51c-e53f-49cf-85fd-a67cf6d0264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:21.179176 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42a51c-e53f-49cf-85fd-a67cf6d0264c admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:21.179484 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42a51c-e53f-49cf-85fd-a67cf6d0264c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:21.179752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42a51c-e53f-49cf-85fd-a67cf6d0264c admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:21.180429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42a51c-e53f-49cf-85fd-a67cf6d0264c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:21.182029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42a51c-e53f-49cf-85fd-a67cf6d0264c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:21.192987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1380/2766] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:10:21.197004 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba1a05-274e-4d86-bb11-bdbaecd02d10 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:21.207844 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba1a05-274e-4d86-bb11-bdbaecd02d10 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:21.212624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c90c-c9fd-49f0-995e-a78c76888aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:21.213214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c90c-c9fd-49f0-995e-a78c76888aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:21.213502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c90c-c9fd-49f0-995e-a78c76888aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:21.213775 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c90c-c9fd-49f0-995e-a78c76888aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:21.214510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4c90c-c9fd-49f0-995e-a78c76888aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:21.216809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4c90c-c9fd-49f0-995e-a78c76888aa1 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:21.227506 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1387/2767] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:10:21.232838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42a51c-e53f-49cf-85fd-a67cf6d0264c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:21.242917 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42a51c-e53f-49cf-85fd-a67cf6d0264c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:21.247525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4394d6b-2201-49e8-8c05-da698e239b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:21.248161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4394d6b-2201-49e8-8c05-da698e239b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:21.248434 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4394d6b-2201-49e8-8c05-da698e239b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:21.248703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4394d6b-2201-49e8-8c05-da698e239b57 admin admin] PATH_INFO: `/v3/projects/a97213d7e8f247ed9c985001a9edae17/users/d6dd278eef344527a2d92f2d23c99c8a/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:21.263779 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4394d6b-2201-49e8-8c05-da698e239b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97213d7e8f247ed9c985001a9edae17, user_id=d6dd278eef344527a2d92f2d23c99c8a, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:21.266419 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4394d6b-2201-49e8-8c05-da698e239b57 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:21.352553 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1381/2768] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:10:21 2022] PUT /identity/v3/projects/a97213d7e8f247ed9c985001a9edae17/users/d6dd278eef344527a2d92f2d23c99c8a/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:21.363709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35493-e2e5-4df5-a259-a076974e5fcc None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:21.363989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35493-e2e5-4df5-a259-a076974e5fcc None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:21.364259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35493-e2e5-4df5-a259-a076974e5fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:21.372096 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:21.393157 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-3bf35493-e2e5-4df5-a259-a076974e5fcc None None] MFA Rules not processed for user `d6dd278eef344527a2d92f2d23c99c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:21.394375 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3bf35493-e2e5-4df5-a259-a076974e5fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:21.461513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1388/2769] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:21.472234 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4394d6b-2201-49e8-8c05-da698e239b57 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:21.473901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-a4394d6b-2201-49e8-8c05-da698e239b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:21.530272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4394d6b-2201-49e8-8c05-da698e239b57 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:21.533861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe31e2-8e29-45ec-8a55-37567095a592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:21.534456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe31e2-8e29-45ec-8a55-37567095a592 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:21.534739 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe31e2-8e29-45ec-8a55-37567095a592 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:21.534991 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe31e2-8e29-45ec-8a55-37567095a592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:21.543592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe31e2-8e29-45ec-8a55-37567095a592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:21.545066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe31e2-8e29-45ec-8a55-37567095a592 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:21.553696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1382/2770] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:10:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:10:31.462340 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=31 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:31.549717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:33.005837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf35493-e2e5-4df5-a259-a076974e5fcc None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:33.068901 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf35493-e2e5-4df5-a259-a076974e5fcc None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:33.073357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:33.073970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:33.074245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:33.074515 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] PATH_INFO: `/v3/users/d6dd278eef344527a2d92f2d23c99c8a` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:33.076360 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6dd278eef344527a2d92f2d23c99c8a)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:33.078281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:33.209317 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6dd278eef344527a2d92f2d23c99c8a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:33.209893 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6dd278eef344527a2d92f2d23c99c8a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:33.217012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6dd278eef344527a2d92f2d23c99c8a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:33.275291 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6dd278eef344527a2d92f2d23c99c8a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:33.288491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6dd278eef344527a2d92f2d23c99c8a'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:33.295180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1389/2771] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:10:33 2022] DELETE /identity/v3/users/d6dd278eef344527a2d92f2d23c99c8a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:33.299724 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aa917-03a3-436c-acfd-e7a4baccd627 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:33.300192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aa917-03a3-436c-acfd-e7a4baccd627 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:33.300300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aa917-03a3-436c-acfd-e7a4baccd627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:33.318920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-d43aa917-03a3-436c-acfd-e7a4baccd627 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:10:33.320157 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d43aa917-03a3-436c-acfd-e7a4baccd627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:33.379054 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1383/2772] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:10:33.389371 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:33.390796 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:33.450234 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab37ed-2af1-4fb5-a6e3-c17f95f62209 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:33.453863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43705a-3ed2-4635-8234-292139c013c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:33.454466 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43705a-3ed2-4635-8234-292139c013c7 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:33.454740 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43705a-3ed2-4635-8234-292139c013c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:33.455005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43705a-3ed2-4635-8234-292139c013c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:33.463985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43705a-3ed2-4635-8234-292139c013c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:33.465380 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43705a-3ed2-4635-8234-292139c013c7 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:33.475030 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1390/2773] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:10:33.891986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43aa917-03a3-436c-acfd-e7a4baccd627 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:10:33.893396 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-d43aa917-03a3-436c-acfd-e7a4baccd627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:10:33.905693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43aa917-03a3-436c-acfd-e7a4baccd627 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:10:33.911055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:10:33.911055 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:10:33.911313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:10:33.911404 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] PATH_INFO: `/v3/projects/a97213d7e8f247ed9c985001a9edae17` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:10:33.912537 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97213d7e8f247ed9c985001a9edae17)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:10:33.914469 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:10:34.030846 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97213d7e8f247ed9c985001a9edae17', 'request_id': 'req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:34.037155 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97213d7e8f247ed9c985001a9edae17', 'request_id': 'req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:34.135708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97213d7e8f247ed9c985001a9edae17', 'request_id': 'req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:34.146862 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] The token cache is being invalidate because project a97213d7e8f247ed9c985001a9edae17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:10:34.147150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:34.147827 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:10:34.149340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1384/2774] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:10:33 2022] DELETE /identity/v3/projects/a97213d7e8f247ed9c985001a9edae17 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:10:43.470871 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:10:44.143877 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:11:18.535990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e4427-a8f6-4bfe-aabe-fa9ac7b89c60 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:11:18.538905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e4427-a8f6-4bfe-aabe-fa9ac7b89c60 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:11:18.538905 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e4427-a8f6-4bfe-aabe-fa9ac7b89c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:11:18.555477 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-080e4427-a8f6-4bfe-aabe-fa9ac7b89c60 None None] MFA Rules not processed for user `c81fde029db243a7935e3e90cef369e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:11:18.556675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-080e4427-a8f6-4bfe-aabe-fa9ac7b89c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:11:18.610141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1391/2775] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:11:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:11:18.918551 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:11:18.919910 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:11:18.977305 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b124e-9e3c-4c41-a8ff-89c1479cfb68 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:11:18.981202 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:11:18.981796 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:11:18.982070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:11:18.982336 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:11:18.984051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:11:18.993473 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:11:18.994891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:11:19.002642 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1385/2776] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:11:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:11:28.604538 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=25 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:11:28.915637 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e4427-a8f6-4bfe-aabe-fa9ac7b89c60 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:11:28.917005 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-080e4427-a8f6-4bfe-aabe-fa9ac7b89c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:11:28.994468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e4427-a8f6-4bfe-aabe-fa9ac7b89c60 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:11:28.999075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=26 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:11:29.000442 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:11:29.001053 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:11:29.001333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:11:29.001605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:11:29.003405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:11:29.017118 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:11:29.018735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:11:29.030745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1392/2777] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:11:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:11:33.494596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:11:33.496148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:11:33.512614 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23caacb2-9d2d-4d83-8f0a-8684d397d959 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:11:33.518389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2467ddf-92fd-435f-9455-cc4fdbe5dbe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:11:33.520482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467ddf-92fd-435f-9455-cc4fdbe5dbe0 service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:11:33.520482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467ddf-92fd-435f-9455-cc4fdbe5dbe0 service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:11:33.520482 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2467ddf-92fd-435f-9455-cc4fdbe5dbe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:11:33.521451 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b2467ddf-92fd-435f-9455-cc4fdbe5dbe0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:11:33.534850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2467ddf-92fd-435f-9455-cc4fdbe5dbe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:11:33.536577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2467ddf-92fd-435f-9455-cc4fdbe5dbe0 service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:11:33.548349 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1386/2778] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:11:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:11:39.025428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=34 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:11:43.543668 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=6 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:12:12.913000 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:12:12.914425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:12:12.982141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0bcc9-731f-444f-9c9c-845fd8431520 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:12:12.987084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f0a32-506d-4cdd-861b-1050fd5550c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:12:12.987698 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0a32-506d-4cdd-861b-1050fd5550c9 service placement] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:12:12.987973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0a32-506d-4cdd-861b-1050fd5550c9 service placement] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:12:12.988238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0a32-506d-4cdd-861b-1050fd5550c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:12:12.989943 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ae7f0a32-506d-4cdd-861b-1050fd5550c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:12:13.001702 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f0a32-506d-4cdd-861b-1050fd5550c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:12:13.003190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f0a32-506d-4cdd-861b-1050fd5550c9 service placement] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:12:13.013583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1393/2779] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:12:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:12:23.008695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=32 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:13:04.278659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed944b-222b-43e0-8c20-9fd821e3fb82 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:13:04.279190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed944b-222b-43e0-8c20-9fd821e3fb82 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:13:04.279190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed944b-222b-43e0-8c20-9fd821e3fb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:13:04.298435 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-62ed944b-222b-43e0-8c20-9fd821e3fb82 None None] MFA Rules not processed for user `c81fde029db243a7935e3e90cef369e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:13:04.299681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-62ed944b-222b-43e0-8c20-9fd821e3fb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:13:04.306656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1387/2780] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:13:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:13:04.617220 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f0a32-506d-4cdd-861b-1050fd5550c9 service placement] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:13:04.626771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f0a32-506d-4cdd-861b-1050fd5550c9 service placement] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:13:04.630360 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:13:04.630945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:13:04.631250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:13:04.631514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:13:04.633215 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:13:04.642695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:13:04.644156 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:13:04.652081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1394/2781] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:13:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:13:14.293149 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:13:14.648534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=6 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:14:45.540146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed944b-222b-43e0-8c20-9fd821e3fb82 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:14:45.553564 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed944b-222b-43e0-8c20-9fd821e3fb82 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:14:45.559667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:14:45.560254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:14:45.560527 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:14:45.560794 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:14:45.562465 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:14:45.572736 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:14:45.574432 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:14:45.583409 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1388/2782] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:14:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:14:47.349352 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:14:47.350816 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:14:47.408410 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2155e2-78f2-4805-be25-7f02c3e2bd5a service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:14:47.411951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8666723-dd4e-4a80-b2b6-0d8f14a4914c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:14:47.412552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8666723-dd4e-4a80-b2b6-0d8f14a4914c service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:14:47.412825 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8666723-dd4e-4a80-b2b6-0d8f14a4914c service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:14:47.413094 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8666723-dd4e-4a80-b2b6-0d8f14a4914c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:14:47.414849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f8666723-dd4e-4a80-b2b6-0d8f14a4914c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:14:47.428955 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8666723-dd4e-4a80-b2b6-0d8f14a4914c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:14:47.430387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8666723-dd4e-4a80-b2b6-0d8f14a4914c service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:14:47.442135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1395/2783] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:14:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:14:50.275681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:14:50.277713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:14:50.289277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f8899-caae-4d8d-9b8e-6cc7237e315a service nova] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:14:50.293498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d41c8-fa6b-4012-ac88-3ae6ce4d427c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:14:50.294085 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d41c8-fa6b-4012-ac88-3ae6ce4d427c service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:14:50.294359 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d41c8-fa6b-4012-ac88-3ae6ce4d427c service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:14:50.294624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d41c8-fa6b-4012-ac88-3ae6ce4d427c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:14:50.296393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-615d41c8-fa6b-4012-ac88-3ae6ce4d427c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:14:50.310121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d41c8-fa6b-4012-ac88-3ae6ce4d427c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:14:50.311583 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d41c8-fa6b-4012-ac88-3ae6ce4d427c service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:14:50.322572 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1389/2784] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:14:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:14:56.226368 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8666723-dd4e-4a80-b2b6-0d8f14a4914c service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:14:56.238936 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8666723-dd4e-4a80-b2b6-0d8f14a4914c service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:14:56.245278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9fffd-f7cf-42e8-9f43-ba71ab1dc213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:14:56.245904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9fffd-f7cf-42e8-9f43-ba71ab1dc213 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:14:56.246180 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9fffd-f7cf-42e8-9f43-ba71ab1dc213 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:14:56.246449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9fffd-f7cf-42e8-9f43-ba71ab1dc213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:14:56.248682 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-67e9fffd-f7cf-42e8-9f43-ba71ab1dc213 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:14:56.261513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9fffd-f7cf-42e8-9f43-ba71ab1dc213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:14:56.263181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9fffd-f7cf-42e8-9f43-ba71ab1dc213 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:14:56.274659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1396/2785] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:14:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:15:00.317771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=12 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:15:01.299363 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5dde0-c261-48be-a8db-ccdbcbe57512 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:15:01.299649 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5dde0-c261-48be-a8db-ccdbcbe57512 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:15:01.299922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5dde0-c261-48be-a8db-ccdbcbe57512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:15:01.319212 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-93c5dde0-c261-48be-a8db-ccdbcbe57512 None None] MFA Rules not processed for user `c81fde029db243a7935e3e90cef369e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:15:01.323436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-93c5dde0-c261-48be-a8db-ccdbcbe57512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:15:01.327456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1390/2786] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:15:02.060389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9fffd-f7cf-42e8-9f43-ba71ab1dc213 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:15:02.072108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9fffd-f7cf-42e8-9f43-ba71ab1dc213 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:15:02.077863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9148b-1344-43ff-80b7-84c1f3d1388e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:15:02.078471 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9148b-1344-43ff-80b7-84c1f3d1388e service placement] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:15:02.078757 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9148b-1344-43ff-80b7-84c1f3d1388e service placement] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:15:02.079026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9148b-1344-43ff-80b7-84c1f3d1388e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:15:02.080813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-81a9148b-1344-43ff-80b7-84c1f3d1388e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:15:02.093675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9148b-1344-43ff-80b7-84c1f3d1388e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:15:02.095484 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9148b-1344-43ff-80b7-84c1f3d1388e service placement] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:15:02.106952 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1397/2787] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:15:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:15:04.694860 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5dde0-c261-48be-a8db-ccdbcbe57512 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:15:04.696467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-93c5dde0-c261-48be-a8db-ccdbcbe57512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:15:04.709816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5dde0-c261-48be-a8db-ccdbcbe57512 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:15:04.713385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:15:04.719130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:15:04.719130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:15:04.719130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:15:04.719130 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:15:04.727073 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:15:04.728618 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:15:04.738481 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1391/2788] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:15:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:15:12.102510 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=38 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:15:14.734615 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=9 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:44.121089 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9148b-1344-43ff-80b7-84c1f3d1388e service placement] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:44.130501 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9148b-1344-43ff-80b7-84c1f3d1388e service placement] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:44.134216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:44.134809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:44.135194 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:44.135678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:44.137570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:44.199990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:44.201361 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:44.210832 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1398/2789] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:16:47.619600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:47.621025 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:47.637525 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f76cda-cc95-438f-9954-44d42dec725d service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:47.642573 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2ab5-12ef-44d5-9642-fb5957a815e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:47.643178 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2ab5-12ef-44d5-9642-fb5957a815e9 service placement] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:47.643494 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2ab5-12ef-44d5-9642-fb5957a815e9 service placement] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:47.643770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2ab5-12ef-44d5-9642-fb5957a815e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:47.645528 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ef1c2ab5-12ef-44d5-9642-fb5957a815e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:47.658420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c2ab5-12ef-44d5-9642-fb5957a815e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:47.660060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c2ab5-12ef-44d5-9642-fb5957a815e9 service placement] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:47.670899 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1392/2790] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:16:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:16:47.748542 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:47.750046 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:47.763320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcd662-8e89-489d-9173-b4a1e094c927 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:47.768037 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:47.768608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:47.768887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:47.769160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] PATH_INFO: `/v3/users/c81fde029db243a7935e3e90cef369e4` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:47.770285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81fde029db243a7935e3e90cef369e4)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:47.772261 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:47.955882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81fde029db243a7935e3e90cef369e4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:47.956615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81fde029db243a7935e3e90cef369e4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:47.967448 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81fde029db243a7935e3e90cef369e4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:48.028593 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81fde029db243a7935e3e90cef369e4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:48.042605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5e9185b4-d775-46d3-b107-68234ecf95fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81fde029db243a7935e3e90cef369e4'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:48.048771 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1399/2791] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:16:47 2022] DELETE /identity/v3/users/c81fde029db243a7935e3e90cef369e4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:48.292939 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2ab5-12ef-44d5-9642-fb5957a815e9 service placement] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:48.303679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2ab5-12ef-44d5-9642-fb5957a815e9 service placement] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:48.363980 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:48.364609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:48.364885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:48.365158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] PATH_INFO: `/v3/projects/dfd76cd8f8f649b3a6231c2f12d530ba` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:48.366268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd76cd8f8f649b3a6231c2f12d530ba)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:48.368263 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:48.468986 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd76cd8f8f649b3a6231c2f12d530ba', 'request_id': 'req-27c67a86-610d-4b8d-b779-788bff534ff4'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:48.475407 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd76cd8f8f649b3a6231c2f12d530ba', 'request_id': 'req-27c67a86-610d-4b8d-b779-788bff534ff4'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:48.562347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd76cd8f8f649b3a6231c2f12d530ba', 'request_id': 'req-27c67a86-610d-4b8d-b779-788bff534ff4'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:48.573941 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] The token cache is being invalidate because project dfd76cd8f8f649b3a6231c2f12d530ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:16:48.575883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:48.575883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-27c67a86-610d-4b8d-b779-788bff534ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:48.576366 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1393/2792] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:16:48 2022] DELETE /identity/v3/projects/dfd76cd8f8f649b3a6231c2f12d530ba => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:48.581319 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b65e8-2cbe-4960-be70-c703c6e23ad1 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:48.581652 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b65e8-2cbe-4960-be70-c703c6e23ad1 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:48.581926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b65e8-2cbe-4960-be70-c703c6e23ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:48.602488 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-693b65e8-2cbe-4960-be70-c703c6e23ad1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:16:48.604532 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-693b65e8-2cbe-4960-be70-c703c6e23ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:48.663402 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1400/2793] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:16:48.671890 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6287e6-645b-48a0-b1b4-b29a7c833eea None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:48.672370 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6287e6-645b-48a0-b1b4-b29a7c833eea None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:48.672467 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6287e6-645b-48a0-b1b4-b29a7c833eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:48.692424 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-aa6287e6-645b-48a0-b1b4-b29a7c833eea None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:16:48.693625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-aa6287e6-645b-48a0-b1b4-b29a7c833eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:48.701915 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1394/2794] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:16:48.706061 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b65e8-2cbe-4960-be70-c703c6e23ad1 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:48.716315 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b65e8-2cbe-4960-be70-c703c6e23ad1 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:48.721363 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899deff5-7786-4c6f-bd7d-b6c87f89a375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:48.721958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899deff5-7786-4c6f-bd7d-b6c87f89a375 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:48.722263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899deff5-7786-4c6f-bd7d-b6c87f89a375 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:48.722531 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899deff5-7786-4c6f-bd7d-b6c87f89a375 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:48.723177 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899deff5-7786-4c6f-bd7d-b6c87f89a375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:16:48.723513 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899deff5-7786-4c6f-bd7d-b6c87f89a375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:48.725110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899deff5-7786-4c6f-bd7d-b6c87f89a375 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:48.726628 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:48.738137 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1401/2795] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:16:48.742222 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6287e6-645b-48a0-b1b4-b29a7c833eea None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:48.752258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6287e6-645b-48a0-b1b4-b29a7c833eea None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:48.756893 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a47a54-9152-44ea-908b-a76ee4bc4383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:48.757486 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a47a54-9152-44ea-908b-a76ee4bc4383 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:48.757758 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a47a54-9152-44ea-908b-a76ee4bc4383 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:48.758021 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a47a54-9152-44ea-908b-a76ee4bc4383 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:48.758631 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a47a54-9152-44ea-908b-a76ee4bc4383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:48.760776 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a47a54-9152-44ea-908b-a76ee4bc4383 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:48.861602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1395/2796] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:16:48 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:16:48.865685 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899deff5-7786-4c6f-bd7d-b6c87f89a375 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:48.876722 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899deff5-7786-4c6f-bd7d-b6c87f89a375 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:48.932237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843dc13-1455-4e06-85ff-6db8e176d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:48.932961 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dc13-1455-4e06-85ff-6db8e176d1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:48.933238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dc13-1455-4e06-85ff-6db8e176d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:48.933509 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dc13-1455-4e06-85ff-6db8e176d1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:48.934136 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843dc13-1455-4e06-85ff-6db8e176d1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:48.936115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843dc13-1455-4e06-85ff-6db8e176d1e3 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.046272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1402/2797] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:16:48 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:16:49.051146 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a47a54-9152-44ea-908b-a76ee4bc4383 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:49.065855 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a47a54-9152-44ea-908b-a76ee4bc4383 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:49.070595 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628fee3-beaf-42da-b5ec-9c53ae3f9c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:49.071198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628fee3-beaf-42da-b5ec-9c53ae3f9c03 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.071535 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628fee3-beaf-42da-b5ec-9c53ae3f9c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.071810 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628fee3-beaf-42da-b5ec-9c53ae3f9c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.072737 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628fee3-beaf-42da-b5ec-9c53ae3f9c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:49.074360 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628fee3-beaf-42da-b5ec-9c53ae3f9c03 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.084498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1396/2798] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:16:49.089138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843dc13-1455-4e06-85ff-6db8e176d1e3 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:49.099586 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843dc13-1455-4e06-85ff-6db8e176d1e3 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:49.105116 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b8da5-71a0-41a6-b6c1-3a34bf5c08ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:49.105715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b8da5-71a0-41a6-b6c1-3a34bf5c08ee admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.106503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b8da5-71a0-41a6-b6c1-3a34bf5c08ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.106503 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b8da5-71a0-41a6-b6c1-3a34bf5c08ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.106885 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b8da5-71a0-41a6-b6c1-3a34bf5c08ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:49.108567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b8da5-71a0-41a6-b6c1-3a34bf5c08ee admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.120504 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1403/2799] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:16:49.124725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628fee3-beaf-42da-b5ec-9c53ae3f9c03 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:49.134632 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628fee3-beaf-42da-b5ec-9c53ae3f9c03 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:49.139820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ff6c2-4726-4ebc-910c-455711da0d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:49.140499 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ff6c2-4726-4ebc-910c-455711da0d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.140778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ff6c2-4726-4ebc-910c-455711da0d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.141047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ff6c2-4726-4ebc-910c-455711da0d39 admin admin] PATH_INFO: `/v3/projects/ccba54932fa542c192329bd6458d7d87/users/f1518a4f3659437897cfa6f0bfecff92/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.156833 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ff6c2-4726-4ebc-910c-455711da0d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccba54932fa542c192329bd6458d7d87, user_id=f1518a4f3659437897cfa6f0bfecff92, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:49.159513 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ff6c2-4726-4ebc-910c-455711da0d39 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.219316 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1397/2800] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:16:49 2022] PUT /identity/v3/projects/ccba54932fa542c192329bd6458d7d87/users/f1518a4f3659437897cfa6f0bfecff92/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:16:49.230263 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e337c10-db71-497d-9f4b-5a7286338ff1 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.230543 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e337c10-db71-497d-9f4b-5a7286338ff1 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.230817 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e337c10-db71-497d-9f4b-5a7286338ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.258141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-0e337c10-db71-497d-9f4b-5a7286338ff1 None None] MFA Rules not processed for user `f1518a4f3659437897cfa6f0bfecff92`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:16:49.259383 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-0e337c10-db71-497d-9f4b-5a7286338ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:49.321749 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1404/2801] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:16:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:16:49.327420 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ff6c2-4726-4ebc-910c-455711da0d39 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:49.341664 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:49.389506 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ff6c2-4726-4ebc-910c-455711da0d39 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:49.394107 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4be6a-b0e0-4a03-b092-d6a47e8c2ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:49.394716 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4be6a-b0e0-4a03-b092-d6a47e8c2ebf admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.395062 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4be6a-b0e0-4a03-b092-d6a47e8c2ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.395587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4be6a-b0e0-4a03-b092-d6a47e8c2ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.396429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4be6a-b0e0-4a03-b092-d6a47e8c2ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:49.398828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4be6a-b0e0-4a03-b092-d6a47e8c2ebf admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.477468 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1398/2802] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:16:49 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:16:49.481636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e337c10-db71-497d-9f4b-5a7286338ff1 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:49.492568 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e337c10-db71-497d-9f4b-5a7286338ff1 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:49.548100 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4cf92-ee8a-4e16-a1bb-58c46ab072d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:49.548695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4cf92-ee8a-4e16-a1bb-58c46ab072d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.548969 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4cf92-ee8a-4e16-a1bb-58c46ab072d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.549238 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4cf92-ee8a-4e16-a1bb-58c46ab072d4 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.549854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4cf92-ee8a-4e16-a1bb-58c46ab072d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:49.551795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4cf92-ee8a-4e16-a1bb-58c46ab072d4 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.561038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:49.653459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1405/2803] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:16:49 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:16:49.657639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4be6a-b0e0-4a03-b092-d6a47e8c2ebf admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:49.667949 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4be6a-b0e0-4a03-b092-d6a47e8c2ebf admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:49.672577 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fa0ce-a07d-49c6-bd91-56267ca4968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:49.673194 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fa0ce-a07d-49c6-bd91-56267ca4968c admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.673436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fa0ce-a07d-49c6-bd91-56267ca4968c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.673707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fa0ce-a07d-49c6-bd91-56267ca4968c admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.674347 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fa0ce-a07d-49c6-bd91-56267ca4968c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:49.675983 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fa0ce-a07d-49c6-bd91-56267ca4968c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.687033 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1399/2804] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:16:49.691152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4cf92-ee8a-4e16-a1bb-58c46ab072d4 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:49.701769 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4cf92-ee8a-4e16-a1bb-58c46ab072d4 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:49.706341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81543c79-f2e9-469e-8d4c-87560dbd8757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:49.706982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81543c79-f2e9-469e-8d4c-87560dbd8757 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.707281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81543c79-f2e9-469e-8d4c-87560dbd8757 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.707555 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81543c79-f2e9-469e-8d4c-87560dbd8757 admin admin] PATH_INFO: `/v3/projects/1c1dcb979f8b4b8099c6eec59d53fa03/users/53bf438ad6244e89a70c83573bdb3ca9/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.722923 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81543c79-f2e9-469e-8d4c-87560dbd8757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1dcb979f8b4b8099c6eec59d53fa03, user_id=53bf438ad6244e89a70c83573bdb3ca9, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:49.725609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81543c79-f2e9-469e-8d4c-87560dbd8757 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.785119 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1406/2805] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:16:49 2022] PUT /identity/v3/projects/1c1dcb979f8b4b8099c6eec59d53fa03/users/53bf438ad6244e89a70c83573bdb3ca9/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:49.789080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fa0ce-a07d-49c6-bd91-56267ca4968c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:49.799606 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fa0ce-a07d-49c6-bd91-56267ca4968c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:49.855472 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0f032-bccc-4193-889f-52d8057dd06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:49.856064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0f032-bccc-4193-889f-52d8057dd06f admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.856341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0f032-bccc-4193-889f-52d8057dd06f admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.856639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0f032-bccc-4193-889f-52d8057dd06f admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.857281 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0f032-bccc-4193-889f-52d8057dd06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:49.858866 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0f032-bccc-4193-889f-52d8057dd06f admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.868459 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1400/2806] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:16:49.872623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81543c79-f2e9-469e-8d4c-87560dbd8757 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:49.884178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81543c79-f2e9-469e-8d4c-87560dbd8757 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:49.889958 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c431d5-9f8d-4867-af9a-54f5ab548d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:49.890613 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c431d5-9f8d-4867-af9a-54f5ab548d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.890913 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c431d5-9f8d-4867-af9a-54f5ab548d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.891178 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c431d5-9f8d-4867-af9a-54f5ab548d01 admin admin] PATH_INFO: `/v3/projects/1c1dcb979f8b4b8099c6eec59d53fa03/users/53bf438ad6244e89a70c83573bdb3ca9/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.893113 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c431d5-9f8d-4867-af9a-54f5ab548d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1dcb979f8b4b8099c6eec59d53fa03, user_id=53bf438ad6244e89a70c83573bdb3ca9, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:49.895815 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c431d5-9f8d-4867-af9a-54f5ab548d01 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:49.906718 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1407/2807] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:16:49 2022] PUT /identity/v3/projects/1c1dcb979f8b4b8099c6eec59d53fa03/users/53bf438ad6244e89a70c83573bdb3ca9/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:49.918386 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710dc1-c79e-47e6-8475-ebc24c36ed42 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:49.918692 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710dc1-c79e-47e6-8475-ebc24c36ed42 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:49.918964 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef710dc1-c79e-47e6-8475-ebc24c36ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:49.946755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ef710dc1-c79e-47e6-8475-ebc24c36ed42 None None] MFA Rules not processed for user `53bf438ad6244e89a70c83573bdb3ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:16:49.948719 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ef710dc1-c79e-47e6-8475-ebc24c36ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:50.015490 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1401/2808] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:16:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:16:50.027430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c431d5-9f8d-4867-af9a-54f5ab548d01 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:50.029152 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-70c431d5-9f8d-4867-af9a-54f5ab548d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:50.086167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c431d5-9f8d-4867-af9a-54f5ab548d01 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:50.090566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b2ad-72b1-4c49-a932-5406f9f4fc5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:50.091161 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b2ad-72b1-4c49-a932-5406f9f4fc5f service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:50.091467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b2ad-72b1-4c49-a932-5406f9f4fc5f service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:50.091738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008b2ad-72b1-4c49-a932-5406f9f4fc5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:50.148350 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008b2ad-72b1-4c49-a932-5406f9f4fc5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:50.149799 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008b2ad-72b1-4c49-a932-5406f9f4fc5f service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:50.159745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1408/2809] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:16:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:16:51.897449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef710dc1-c79e-47e6-8475-ebc24c36ed42 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:51.898762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ef710dc1-c79e-47e6-8475-ebc24c36ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:51.910726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef710dc1-c79e-47e6-8475-ebc24c36ed42 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:51.914295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541ae00-db6e-4ca7-861b-780f8a9f43d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:51.914885 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541ae00-db6e-4ca7-861b-780f8a9f43d7 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:51.915179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541ae00-db6e-4ca7-861b-780f8a9f43d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:51.915475 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541ae00-db6e-4ca7-861b-780f8a9f43d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:51.922254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:51.924403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541ae00-db6e-4ca7-861b-780f8a9f43d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:51.925828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541ae00-db6e-4ca7-861b-780f8a9f43d7 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:51.936177 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1402/2810] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:16:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:16:56.104445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b2ad-72b1-4c49-a932-5406f9f4fc5f service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:56.166805 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008b2ad-72b1-4c49-a932-5406f9f4fc5f service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:56.171486 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:56.172106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:56.172377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:56.172644 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] PATH_INFO: `/v3/users/f1518a4f3659437897cfa6f0bfecff92` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:56.173745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1518a4f3659437897cfa6f0bfecff92)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:56.175706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:56.185692 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:56.339018 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1518a4f3659437897cfa6f0bfecff92'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:56.339619 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1518a4f3659437897cfa6f0bfecff92'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:56.347445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1518a4f3659437897cfa6f0bfecff92'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:56.407630 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1518a4f3659437897cfa6f0bfecff92'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:56.420672 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1518a4f3659437897cfa6f0bfecff92'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:56.426734 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1409/2811] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:16:56 2022] DELETE /identity/v3/users/f1518a4f3659437897cfa6f0bfecff92 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:56.431387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85956f6-0e61-4140-805f-173dbb01040b None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:56.431987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85956f6-0e61-4140-805f-173dbb01040b None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:56.431987 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85956f6-0e61-4140-805f-173dbb01040b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:56.451346 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f85956f6-0e61-4140-805f-173dbb01040b None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:16:56.452538 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f85956f6-0e61-4140-805f-173dbb01040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:56.511300 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1403/2812] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:16:56.521655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:56.523034 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:56.580290 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e84e8-06e0-4d2f-a00c-d1a99d41c3ee admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:56.583956 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86f030-96e4-43e3-9e5f-70f723737fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:56.584550 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86f030-96e4-43e3-9e5f-70f723737fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:56.584829 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86f030-96e4-43e3-9e5f-70f723737fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:56.585108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86f030-96e4-43e3-9e5f-70f723737fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:56.594058 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86f030-96e4-43e3-9e5f-70f723737fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:56.595456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86f030-96e4-43e3-9e5f-70f723737fb1 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:56.605039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1410/2813] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:16:57.008907 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85956f6-0e61-4140-805f-173dbb01040b None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:57.010414 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f85956f6-0e61-4140-805f-173dbb01040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:57.024075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85956f6-0e61-4140-805f-173dbb01040b None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:57.029752 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:57.030677 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:57.031016 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:57.031208 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] PATH_INFO: `/v3/projects/ccba54932fa542c192329bd6458d7d87` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:57.032351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccba54932fa542c192329bd6458d7d87)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:57.034271 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:57.123777 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccba54932fa542c192329bd6458d7d87', 'request_id': 'req-21d18163-81d0-42b1-851b-e9c2ec4be02d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.130121 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccba54932fa542c192329bd6458d7d87', 'request_id': 'req-21d18163-81d0-42b1-851b-e9c2ec4be02d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.190110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccba54932fa542c192329bd6458d7d87', 'request_id': 'req-21d18163-81d0-42b1-851b-e9c2ec4be02d'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.201348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] The token cache is being invalidate because project ccba54932fa542c192329bd6458d7d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:16:57.201635 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.202629 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.203828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1404/2814] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:16:57 2022] DELETE /identity/v3/projects/ccba54932fa542c192329bd6458d7d87 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:57.207865 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86f030-96e4-43e3-9e5f-70f723737fb1 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:57.218217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86f030-96e4-43e3-9e5f-70f723737fb1 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:57.273878 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:57.274498 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:57.274774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:57.275044 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] PATH_INFO: `/v3/users/53bf438ad6244e89a70c83573bdb3ca9` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:57.276190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53bf438ad6244e89a70c83573bdb3ca9)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:57.278121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:57.470147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:57.482579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53bf438ad6244e89a70c83573bdb3ca9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.483266 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53bf438ad6244e89a70c83573bdb3ca9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.490259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53bf438ad6244e89a70c83573bdb3ca9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.582285 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53bf438ad6244e89a70c83573bdb3ca9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.595547 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-944955d8-186c-4e65-aea5-842d25152362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53bf438ad6244e89a70c83573bdb3ca9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:57.601603 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1411/2815] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:16:57 2022] DELETE /identity/v3/users/53bf438ad6244e89a70c83573bdb3ca9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:58.034695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:58.034695 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:58.048384 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d18163-81d0-42b1-851b-e9c2ec4be02d admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:58.107493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:58.108127 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:58.108446 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:58.108718 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] PATH_INFO: `/v3/projects/1c1dcb979f8b4b8099c6eec59d53fa03` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:58.109843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1dcb979f8b4b8099c6eec59d53fa03)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:58.111802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:58.134240 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:58.236755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1dcb979f8b4b8099c6eec59d53fa03', 'request_id': 'req-4e0ba4be-7431-4531-bf67-3d9cf806b574'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:58.243015 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1dcb979f8b4b8099c6eec59d53fa03', 'request_id': 'req-4e0ba4be-7431-4531-bf67-3d9cf806b574'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:58.319639 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1dcb979f8b4b8099c6eec59d53fa03', 'request_id': 'req-4e0ba4be-7431-4531-bf67-3d9cf806b574'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:58.331276 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] The token cache is being invalidate because project 1c1dcb979f8b4b8099c6eec59d53fa03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:16:58.331570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:58.332238 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-4e0ba4be-7431-4531-bf67-3d9cf806b574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:16:58.333729 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1405/2816] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:16:58 2022] DELETE /identity/v3/projects/1c1dcb979f8b4b8099c6eec59d53fa03 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:58.338746 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704d25-c642-497f-a83e-2f8b839d3c9e None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:58.339268 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704d25-c642-497f-a83e-2f8b839d3c9e None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:58.339389 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704d25-c642-497f-a83e-2f8b839d3c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:58.359633 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-f3704d25-c642-497f-a83e-2f8b839d3c9e None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:16:58.360822 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f3704d25-c642-497f-a83e-2f8b839d3c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:58.420267 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1412/2817] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:16:58.428048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5521c-378a-40db-b5ee-fce6b89b60c7 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:58.428335 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5521c-378a-40db-b5ee-fce6b89b60c7 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:58.428659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5521c-378a-40db-b5ee-fce6b89b60c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:58.448371 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-12a5521c-378a-40db-b5ee-fce6b89b60c7 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:16:58.449574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-12a5521c-378a-40db-b5ee-fce6b89b60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:58.458385 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1406/2818] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:16:58.462552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3704d25-c642-497f-a83e-2f8b839d3c9e None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:58.473035 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3704d25-c642-497f-a83e-2f8b839d3c9e None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:58.477133 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f360-57b3-4759-913e-c38f4ecb6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:58.477721 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f360-57b3-4759-913e-c38f4ecb6a5b admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:58.477993 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f360-57b3-4759-913e-c38f4ecb6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:58.478259 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f360-57b3-4759-913e-c38f4ecb6a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:58.478919 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220f360-57b3-4759-913e-c38f4ecb6a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:16:58.479245 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220f360-57b3-4759-913e-c38f4ecb6a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:58.480838 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220f360-57b3-4759-913e-c38f4ecb6a5b admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:58.492430 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1413/2819] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:16:58.496559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5521c-378a-40db-b5ee-fce6b89b60c7 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:58.506150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5521c-378a-40db-b5ee-fce6b89b60c7 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:58.510802 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1231f0-d8ed-406b-8fe8-b71fbe2bdfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:58.511426 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1231f0-d8ed-406b-8fe8-b71fbe2bdfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:58.511701 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1231f0-d8ed-406b-8fe8-b71fbe2bdfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:58.511978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1231f0-d8ed-406b-8fe8-b71fbe2bdfb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:58.512600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1231f0-d8ed-406b-8fe8-b71fbe2bdfb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:58.515196 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1231f0-d8ed-406b-8fe8-b71fbe2bdfb8 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:58.598004 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1407/2820] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:16:58 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:16:58.602325 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f360-57b3-4759-913e-c38f4ecb6a5b admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:58.614241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f360-57b3-4759-913e-c38f4ecb6a5b admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:58.679647 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d885c6-df5b-4f09-9619-e0df801d405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:58.694608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d885c6-df5b-4f09-9619-e0df801d405a admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:58.694608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d885c6-df5b-4f09-9619-e0df801d405a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:58.694608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d885c6-df5b-4f09-9619-e0df801d405a admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:58.694608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d885c6-df5b-4f09-9619-e0df801d405a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:58.694608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d885c6-df5b-4f09-9619-e0df801d405a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:58.865896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1414/2821] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:16:58 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:16:58.868203 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1231f0-d8ed-406b-8fe8-b71fbe2bdfb8 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:58.879546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1231f0-d8ed-406b-8fe8-b71fbe2bdfb8 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:58.884152 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce7b74-df92-4566-b60c-b491d5967619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:58.884744 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce7b74-df92-4566-b60c-b491d5967619 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:58.885023 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce7b74-df92-4566-b60c-b491d5967619 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:58.885295 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce7b74-df92-4566-b60c-b491d5967619 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:58.885938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce7b74-df92-4566-b60c-b491d5967619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:58.887584 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce7b74-df92-4566-b60c-b491d5967619 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:58.897793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1408/2822] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:16:58.901636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d885c6-df5b-4f09-9619-e0df801d405a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:58.911819 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d885c6-df5b-4f09-9619-e0df801d405a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:58.917521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f2fcf-ef38-4e08-943e-e778a372287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:58.917521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f2fcf-ef38-4e08-943e-e778a372287a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:58.917521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f2fcf-ef38-4e08-943e-e778a372287a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:58.917521 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f2fcf-ef38-4e08-943e-e778a372287a admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:58.918110 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f2fcf-ef38-4e08-943e-e778a372287a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:58.920423 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f2fcf-ef38-4e08-943e-e778a372287a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:58.930859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1415/2823] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:16:58.934936 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce7b74-df92-4566-b60c-b491d5967619 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:58.945505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce7b74-df92-4566-b60c-b491d5967619 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:58.949958 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c24a2-80e2-45ff-9db9-779eece8b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:58.951117 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c24a2-80e2-45ff-9db9-779eece8b918 admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:58.951454 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c24a2-80e2-45ff-9db9-779eece8b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:58.951787 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c24a2-80e2-45ff-9db9-779eece8b918 admin admin] PATH_INFO: `/v3/projects/7600e319d0924a9ea82e0d3727617526/users/42514b72a03440298b77a8c604172231/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:58.965826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c24a2-80e2-45ff-9db9-779eece8b918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7600e319d0924a9ea82e0d3727617526, user_id=42514b72a03440298b77a8c604172231, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:58.969284 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c24a2-80e2-45ff-9db9-779eece8b918 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:59.036645 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1409/2824] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:16:58 2022] PUT /identity/v3/projects/7600e319d0924a9ea82e0d3727617526/users/42514b72a03440298b77a8c604172231/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:59.049186 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f8a46-3c68-4a97-9f1b-adc5693e7815 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:59.049467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f8a46-3c68-4a97-9f1b-adc5693e7815 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:59.049765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f8a46-3c68-4a97-9f1b-adc5693e7815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:59.078172 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-8a6f8a46-3c68-4a97-9f1b-adc5693e7815 None None] MFA Rules not processed for user `42514b72a03440298b77a8c604172231`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:16:59.079417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8a6f8a46-3c68-4a97-9f1b-adc5693e7815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:59.083358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:59.146236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1416/2825] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:16:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:16:59.150257 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c24a2-80e2-45ff-9db9-779eece8b918 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:59.212554 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c24a2-80e2-45ff-9db9-779eece8b918 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:59.217840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6ec66-3b9c-4012-a4ae-133abf1a9a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:59.218443 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6ec66-3b9c-4012-a4ae-133abf1a9a8b admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:59.218722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6ec66-3b9c-4012-a4ae-133abf1a9a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:59.218996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6ec66-3b9c-4012-a4ae-133abf1a9a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:59.219670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6ec66-3b9c-4012-a4ae-133abf1a9a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:59.221840 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6ec66-3b9c-4012-a4ae-133abf1a9a8b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:59.300308 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1410/2826] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:16:59 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:16:59.304313 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f8a46-3c68-4a97-9f1b-adc5693e7815 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:59.315051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f8a46-3c68-4a97-9f1b-adc5693e7815 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:59.371553 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac4209-e86a-4c8c-9166-a4f4c9260c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:59.372202 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac4209-e86a-4c8c-9166-a4f4c9260c10 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:59.372439 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac4209-e86a-4c8c-9166-a4f4c9260c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:59.372705 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac4209-e86a-4c8c-9166-a4f4c9260c10 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:59.373398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac4209-e86a-4c8c-9166-a4f4c9260c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:59.375356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac4209-e86a-4c8c-9166-a4f4c9260c10 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:59.508500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1417/2827] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:16:59 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:16:59.512455 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6ec66-3b9c-4012-a4ae-133abf1a9a8b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:59.522867 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6ec66-3b9c-4012-a4ae-133abf1a9a8b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:59.527345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ce4d9-5f06-430e-9438-6f11c995806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:59.527979 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ce4d9-5f06-430e-9438-6f11c995806b admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:59.528254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ce4d9-5f06-430e-9438-6f11c995806b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:59.529069 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ce4d9-5f06-430e-9438-6f11c995806b admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:59.529844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ce4d9-5f06-430e-9438-6f11c995806b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:59.531562 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ce4d9-5f06-430e-9438-6f11c995806b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:59.541902 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1411/2828] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:16:59.546709 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac4209-e86a-4c8c-9166-a4f4c9260c10 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:59.556660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac4209-e86a-4c8c-9166-a4f4c9260c10 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:59.561370 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e8366-9dda-4970-b7d7-7b50965776d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:59.562009 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8366-9dda-4970-b7d7-7b50965776d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:59.562287 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8366-9dda-4970-b7d7-7b50965776d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:59.562561 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8366-9dda-4970-b7d7-7b50965776d0 admin admin] PATH_INFO: `/v3/projects/53ebdda05a754a6780f74416e6eb8aed/users/cd8c03c0a93441c19df8ec6cc7ca3e54/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:59.577859 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e8366-9dda-4970-b7d7-7b50965776d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ebdda05a754a6780f74416e6eb8aed, user_id=cd8c03c0a93441c19df8ec6cc7ca3e54, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:59.580570 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e8366-9dda-4970-b7d7-7b50965776d0 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:59.653549 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1418/2829] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:16:59 2022] PUT /identity/v3/projects/53ebdda05a754a6780f74416e6eb8aed/users/cd8c03c0a93441c19df8ec6cc7ca3e54/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:59.658066 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ce4d9-5f06-430e-9438-6f11c995806b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:59.668195 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ce4d9-5f06-430e-9438-6f11c995806b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:59.684826 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:59.726741 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63904fdb-63be-4aaa-95eb-c367edf975b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:59.727286 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904fdb-63be-4aaa-95eb-c367edf975b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:59.727585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904fdb-63be-4aaa-95eb-c367edf975b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:59.727843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63904fdb-63be-4aaa-95eb-c367edf975b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:59.728480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63904fdb-63be-4aaa-95eb-c367edf975b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:59.730141 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63904fdb-63be-4aaa-95eb-c367edf975b3 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:59.740937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1412/2830] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:16:59.745132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e8366-9dda-4970-b7d7-7b50965776d0 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:59.756446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e8366-9dda-4970-b7d7-7b50965776d0 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:59.761127 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3cfab-e2f3-4a1a-ae6c-2dbc2134bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:59.761780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3cfab-e2f3-4a1a-ae6c-2dbc2134bf05 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:59.762059 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3cfab-e2f3-4a1a-ae6c-2dbc2134bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:59.762333 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3cfab-e2f3-4a1a-ae6c-2dbc2134bf05 admin admin] PATH_INFO: `/v3/projects/53ebdda05a754a6780f74416e6eb8aed/users/cd8c03c0a93441c19df8ec6cc7ca3e54/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:59.764347 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3cfab-e2f3-4a1a-ae6c-2dbc2134bf05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ebdda05a754a6780f74416e6eb8aed, user_id=cd8c03c0a93441c19df8ec6cc7ca3e54, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:59.767015 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3cfab-e2f3-4a1a-ae6c-2dbc2134bf05 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:16:59.777148 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1419/2831] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:16:59 2022] PUT /identity/v3/projects/53ebdda05a754a6780f74416e6eb8aed/users/cd8c03c0a93441c19df8ec6cc7ca3e54/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:16:59.787700 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4dd1a-ebb9-4402-833b-3bbee40c30a0 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:59.787984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4dd1a-ebb9-4402-833b-3bbee40c30a0 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:59.788255 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4dd1a-ebb9-4402-833b-3bbee40c30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:59.817072 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8da4dd1a-ebb9-4402-833b-3bbee40c30a0 None None] MFA Rules not processed for user `cd8c03c0a93441c19df8ec6cc7ca3e54`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:16:59.821934 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8da4dd1a-ebb9-4402-833b-3bbee40c30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:59.891144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1413/2832] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:16:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:16:59.898655 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3cfab-e2f3-4a1a-ae6c-2dbc2134bf05 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:16:59.900459 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-45d3cfab-e2f3-4a1a-ae6c-2dbc2134bf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:16:59.956977 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:16:59.980548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3cfab-e2f3-4a1a-ae6c-2dbc2134bf05 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:16:59.984346 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392eddf-807c-4b0c-87ff-560ac024791d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:16:59.984926 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392eddf-807c-4b0c-87ff-560ac024791d service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:16:59.985200 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392eddf-807c-4b0c-87ff-560ac024791d service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:16:59.985468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392eddf-807c-4b0c-87ff-560ac024791d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:16:59.994229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392eddf-807c-4b0c-87ff-560ac024791d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:16:59.995694 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392eddf-807c-4b0c-87ff-560ac024791d service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:00.006132 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1420/2833] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:16:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:00.113973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4dd1a-ebb9-4402-833b-3bbee40c30a0 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:00.123968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4dd1a-ebb9-4402-833b-3bbee40c30a0 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:00.127575 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d27b73-5ca2-4ae3-9e60-848b3205fa1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:00.128161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27b73-5ca2-4ae3-9e60-848b3205fa1f service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:00.128436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27b73-5ca2-4ae3-9e60-848b3205fa1f service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:00.128703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27b73-5ca2-4ae3-9e60-848b3205fa1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:00.184722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27b73-5ca2-4ae3-9e60-848b3205fa1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:00.186319 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27b73-5ca2-4ae3-9e60-848b3205fa1f service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:00.195118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1414/2834] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:03.300457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392eddf-807c-4b0c-87ff-560ac024791d service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:03.403401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392eddf-807c-4b0c-87ff-560ac024791d service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:03.408723 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:03.409349 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:03.409624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:03.409894 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] PATH_INFO: `/v3/users/42514b72a03440298b77a8c604172231` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:03.411039 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] RBAC: Authorizing `identity:delete_user(user_id=42514b72a03440298b77a8c604172231)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:03.413007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:03.626660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42514b72a03440298b77a8c604172231'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:03.627305 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42514b72a03440298b77a8c604172231'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:03.634597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42514b72a03440298b77a8c604172231'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:03.692743 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42514b72a03440298b77a8c604172231'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:03.705782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42514b72a03440298b77a8c604172231'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:03.711758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1421/2835] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:17:03 2022] DELETE /identity/v3/users/42514b72a03440298b77a8c604172231 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:03.716247 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f48c53-a359-462a-b7a9-e39db700316f None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:03.716725 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f48c53-a359-462a-b7a9-e39db700316f None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:03.716830 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f48c53-a359-462a-b7a9-e39db700316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:03.756619 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f6f48c53-a359-462a-b7a9-e39db700316f None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:03.757887 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f6f48c53-a359-462a-b7a9-e39db700316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:03.774762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:03.817430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1415/2836] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:17:03.827127 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:03.828688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:03.843813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:03.886495 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacd35a-0607-49c8-83c1-9166aba3615d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:03.890344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2bfcd-3815-4862-ab01-d06b2b31e09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:03.890939 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2bfcd-3815-4862-ab01-d06b2b31e09a service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:03.891216 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2bfcd-3815-4862-ab01-d06b2b31e09a service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:03.891516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2bfcd-3815-4862-ab01-d06b2b31e09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:03.901179 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2bfcd-3815-4862-ab01-d06b2b31e09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:03.902914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2bfcd-3815-4862-ab01-d06b2b31e09a service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:03.912890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1422/2837] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:04.334244 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f48c53-a359-462a-b7a9-e39db700316f None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:04.335717 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f6f48c53-a359-462a-b7a9-e39db700316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:04.350516 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f48c53-a359-462a-b7a9-e39db700316f None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:04.355592 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:04.356251 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:04.356500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:04.356770 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] PATH_INFO: `/v3/projects/7600e319d0924a9ea82e0d3727617526` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:04.357891 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7600e319d0924a9ea82e0d3727617526)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:04.360502 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:04.464913 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7600e319d0924a9ea82e0d3727617526', 'request_id': 'req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.471864 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7600e319d0924a9ea82e0d3727617526', 'request_id': 'req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.526948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7600e319d0924a9ea82e0d3727617526', 'request_id': 'req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.538559 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] The token cache is being invalidate because project 7600e319d0924a9ea82e0d3727617526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:17:04.538869 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.539529 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.541003 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1416/2838] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:17:04 2022] DELETE /identity/v3/projects/7600e319d0924a9ea82e0d3727617526 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:04.545043 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2bfcd-3815-4862-ab01-d06b2b31e09a service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:04.555425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2bfcd-3815-4862-ab01-d06b2b31e09a service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:04.612151 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:04.612782 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:04.613057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:04.613327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] PATH_INFO: `/v3/users/cd8c03c0a93441c19df8ec6cc7ca3e54` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:04.614462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8c03c0a93441c19df8ec6cc7ca3e54)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:04.616433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:04.798331 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8c03c0a93441c19df8ec6cc7ca3e54'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.798975 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8c03c0a93441c19df8ec6cc7ca3e54'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.805911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8c03c0a93441c19df8ec6cc7ca3e54'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.870049 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8c03c0a93441c19df8ec6cc7ca3e54'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.883358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-eaf91f6e-4c31-40a0-b1de-fc5ea1dc5ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8c03c0a93441c19df8ec6cc7ca3e54'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:04.889324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1423/2839] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:17:04 2022] DELETE /identity/v3/users/cd8c03c0a93441c19df8ec6cc7ca3e54 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:05.305628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:05.307092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:05.321352 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21b0a-c818-46c5-a0f7-396a1f510cc0 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:05.379190 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:05.379771 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:05.380051 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:05.380326 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] PATH_INFO: `/v3/projects/53ebdda05a754a6780f74416e6eb8aed` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:05.381445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ebdda05a754a6780f74416e6eb8aed)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:05.383391 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:05.486742 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:05.487984 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ebdda05a754a6780f74416e6eb8aed', 'request_id': 'req-777f4e45-6592-48f1-b25d-f600653e095c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:05.493999 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ebdda05a754a6780f74416e6eb8aed', 'request_id': 'req-777f4e45-6592-48f1-b25d-f600653e095c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:05.581818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ebdda05a754a6780f74416e6eb8aed', 'request_id': 'req-777f4e45-6592-48f1-b25d-f600653e095c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:05.592661 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] The token cache is being invalidate because project 53ebdda05a754a6780f74416e6eb8aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:17:05.592946 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:05.593576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-777f4e45-6592-48f1-b25d-f600653e095c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:05.595118 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1417/2840] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:17:05 2022] DELETE /identity/v3/projects/53ebdda05a754a6780f74416e6eb8aed => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:05.600377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3723-bab9-4b45-89f3-cd947e085fd1 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:05.600851 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3723-bab9-4b45-89f3-cd947e085fd1 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:05.600989 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3723-bab9-4b45-89f3-cd947e085fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:05.649938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-6b9a3723-bab9-4b45-89f3-cd947e085fd1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:05.651056 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-6b9a3723-bab9-4b45-89f3-cd947e085fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:05.656310 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:05.710774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1424/2841] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:05.718690 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9b396-59b3-4909-aa52-1eb9b523aad4 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:05.718976 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9b396-59b3-4909-aa52-1eb9b523aad4 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:05.719343 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9b396-59b3-4909-aa52-1eb9b523aad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:05.739693 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-12d9b396-59b3-4909-aa52-1eb9b523aad4 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:05.740898 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-12d9b396-59b3-4909-aa52-1eb9b523aad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:05.748722 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1418/2842] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:05.753479 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a3723-bab9-4b45-89f3-cd947e085fd1 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:05.762959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a3723-bab9-4b45-89f3-cd947e085fd1 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:05.767639 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fd88-804d-4929-bcaa-17f89b5e3f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:05.768229 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fd88-804d-4929-bcaa-17f89b5e3f2a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:05.768500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fd88-804d-4929-bcaa-17f89b5e3f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:05.768764 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fd88-804d-4929-bcaa-17f89b5e3f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:05.769398 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fd88-804d-4929-bcaa-17f89b5e3f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:17:05.769693 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fd88-804d-4929-bcaa-17f89b5e3f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:05.771297 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fd88-804d-4929-bcaa-17f89b5e3f2a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:05.782738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1425/2843] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:17:05.786881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9b396-59b3-4909-aa52-1eb9b523aad4 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:05.796006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9b396-59b3-4909-aa52-1eb9b523aad4 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:05.801208 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61508-61c7-41d5-8984-e54795feb158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:05.801791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61508-61c7-41d5-8984-e54795feb158 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:05.802067 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61508-61c7-41d5-8984-e54795feb158 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:05.802340 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61508-61c7-41d5-8984-e54795feb158 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:05.802972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae61508-61c7-41d5-8984-e54795feb158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:05.804906 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae61508-61c7-41d5-8984-e54795feb158 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:05.885843 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1419/2844] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:17:05 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:05.890193 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fd88-804d-4929-bcaa-17f89b5e3f2a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:05.900600 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fd88-804d-4929-bcaa-17f89b5e3f2a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:05.958358 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad2537-625e-4e20-b1a7-a0d7ae69c416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:05.958967 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad2537-625e-4e20-b1a7-a0d7ae69c416 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:05.959344 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad2537-625e-4e20-b1a7-a0d7ae69c416 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:05.959624 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad2537-625e-4e20-b1a7-a0d7ae69c416 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:05.960244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad2537-625e-4e20-b1a7-a0d7ae69c416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:05.962170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad2537-625e-4e20-b1a7-a0d7ae69c416 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:06.033776 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1426/2845] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:17:05 2022] POST /identity/v3/users => generated 305 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:06.037945 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61508-61c7-41d5-8984-e54795feb158 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:06.049060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61508-61c7-41d5-8984-e54795feb158 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:06.053660 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e946-252a-4c30-b415-02b91d4eecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:06.054249 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e946-252a-4c30-b415-02b91d4eecdc admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:06.054523 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e946-252a-4c30-b415-02b91d4eecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:06.054920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191e946-252a-4c30-b415-02b91d4eecdc admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:06.055656 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e946-252a-4c30-b415-02b91d4eecdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:06.057278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191e946-252a-4c30-b415-02b91d4eecdc admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:06.068034 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1420/2846] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:06.072088 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad2537-625e-4e20-b1a7-a0d7ae69c416 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:06.082795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad2537-625e-4e20-b1a7-a0d7ae69c416 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:06.087650 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a9266-4203-479c-b9d7-45df14df9477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:06.088244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a9266-4203-479c-b9d7-45df14df9477 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:06.088522 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a9266-4203-479c-b9d7-45df14df9477 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:06.088793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a9266-4203-479c-b9d7-45df14df9477 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:06.089429 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a9266-4203-479c-b9d7-45df14df9477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:06.091028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a9266-4203-479c-b9d7-45df14df9477 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:06.102103 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1427/2847] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:06.107400 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e946-252a-4c30-b415-02b91d4eecdc admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:06.117392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191e946-252a-4c30-b415-02b91d4eecdc admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:06.121967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea2b5c-925d-4c0d-8983-3cc682de1b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:06.122599 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea2b5c-925d-4c0d-8983-3cc682de1b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:06.122876 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea2b5c-925d-4c0d-8983-3cc682de1b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:06.123147 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea2b5c-925d-4c0d-8983-3cc682de1b7e admin admin] PATH_INFO: `/v3/projects/0b57865f56934e8ca8a22e4a8a6e23ac/users/cf64c66a758f488fa2da8d9ef2d8e15c/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:06.137963 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea2b5c-925d-4c0d-8983-3cc682de1b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b57865f56934e8ca8a22e4a8a6e23ac, user_id=cf64c66a758f488fa2da8d9ef2d8e15c, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:06.140672 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea2b5c-925d-4c0d-8983-3cc682de1b7e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:06.236417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1421/2848] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:17:06 2022] PUT /identity/v3/projects/0b57865f56934e8ca8a22e4a8a6e23ac/users/cf64c66a758f488fa2da8d9ef2d8e15c/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:17:06.300658 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1a980-5005-4d68-b914-3c20072002ef None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:06.300959 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1a980-5005-4d68-b914-3c20072002ef None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:06.301224 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1a980-5005-4d68-b914-3c20072002ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:06.328679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-f6c1a980-5005-4d68-b914-3c20072002ef None None] MFA Rules not processed for user `cf64c66a758f488fa2da8d9ef2d8e15c`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:06.329995 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f6c1a980-5005-4d68-b914-3c20072002ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:06.393007 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1428/2849] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:06 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:06.397765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea2b5c-925d-4c0d-8983-3cc682de1b7e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:06.458361 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea2b5c-925d-4c0d-8983-3cc682de1b7e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:06.462948 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6555a5-e3a4-4996-8a97-1517eb8dea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:06.463574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6555a5-e3a4-4996-8a97-1517eb8dea5b admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:06.463849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6555a5-e3a4-4996-8a97-1517eb8dea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:06.464115 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6555a5-e3a4-4996-8a97-1517eb8dea5b admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:06.464730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6555a5-e3a4-4996-8a97-1517eb8dea5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:06.466620 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6555a5-e3a4-4996-8a97-1517eb8dea5b admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:06.606533 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1422/2850] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:17:06 2022] POST /identity/v3/projects => generated 407 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:06.611415 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1a980-5005-4d68-b914-3c20072002ef None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:06.622129 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1a980-5005-4d68-b914-3c20072002ef None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:06.626425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:06.681274 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c964eb1-36ed-40b8-8a80-15c12efc476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:06.681866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c964eb1-36ed-40b8-8a80-15c12efc476a admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:06.682144 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c964eb1-36ed-40b8-8a80-15c12efc476a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:06.682417 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c964eb1-36ed-40b8-8a80-15c12efc476a admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:06.683033 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c964eb1-36ed-40b8-8a80-15c12efc476a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:06.684970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c964eb1-36ed-40b8-8a80-15c12efc476a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:06.782867 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1429/2851] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:17:06 2022] POST /identity/v3/users => generated 310 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:06.786952 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6555a5-e3a4-4996-8a97-1517eb8dea5b admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:06.797900 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6555a5-e3a4-4996-8a97-1517eb8dea5b admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:06.804585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e1b7c-9adc-46b6-a8ad-92e5fb95a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:06.804585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1b7c-9adc-46b6-a8ad-92e5fb95a806 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:06.804585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1b7c-9adc-46b6-a8ad-92e5fb95a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:06.804585 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1b7c-9adc-46b6-a8ad-92e5fb95a806 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:06.805002 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e1b7c-9adc-46b6-a8ad-92e5fb95a806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:06.806080 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e1b7c-9adc-46b6-a8ad-92e5fb95a806 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:06.816880 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1423/2852] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:06.820970 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c964eb1-36ed-40b8-8a80-15c12efc476a admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:06.831786 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c964eb1-36ed-40b8-8a80-15c12efc476a admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:06.836309 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2a03-d2a8-48e4-9dca-cab06417cc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:06.836946 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2a03-d2a8-48e4-9dca-cab06417cc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:06.837221 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2a03-d2a8-48e4-9dca-cab06417cc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:06.837491 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb2a03-d2a8-48e4-9dca-cab06417cc7c admin admin] PATH_INFO: `/v3/projects/873452897b44473480203846b87b02e1/users/59a675b9da594136ad14d4afb0ded383/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:06.853029 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb2a03-d2a8-48e4-9dca-cab06417cc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=873452897b44473480203846b87b02e1, user_id=59a675b9da594136ad14d4afb0ded383, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:06.855760 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb2a03-d2a8-48e4-9dca-cab06417cc7c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:06.919239 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1430/2853] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:17:06 2022] PUT /identity/v3/projects/873452897b44473480203846b87b02e1/users/59a675b9da594136ad14d4afb0ded383/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:06.923703 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e1b7c-9adc-46b6-a8ad-92e5fb95a806 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:06.933611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e1b7c-9adc-46b6-a8ad-92e5fb95a806 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:06.976995 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:06.990971 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4ad8d-773c-4509-918d-e39076c444ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:06.991687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4ad8d-773c-4509-918d-e39076c444ad admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:06.993290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4ad8d-773c-4509-918d-e39076c444ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:06.993290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4ad8d-773c-4509-918d-e39076c444ad admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:06.993290 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4ad8d-773c-4509-918d-e39076c444ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:06.994474 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4ad8d-773c-4509-918d-e39076c444ad admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:07.004091 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1424/2854] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:07.008434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2a03-d2a8-48e4-9dca-cab06417cc7c admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:07.019190 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb2a03-d2a8-48e4-9dca-cab06417cc7c admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:07.023839 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10617d-2b26-4c22-ad7e-a9bf2dbc1ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:07.024456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10617d-2b26-4c22-ad7e-a9bf2dbc1ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:07.024729 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10617d-2b26-4c22-ad7e-a9bf2dbc1ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:07.024997 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10617d-2b26-4c22-ad7e-a9bf2dbc1ed0 admin admin] PATH_INFO: `/v3/projects/873452897b44473480203846b87b02e1/users/59a675b9da594136ad14d4afb0ded383/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:07.026882 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10617d-2b26-4c22-ad7e-a9bf2dbc1ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873452897b44473480203846b87b02e1, user_id=59a675b9da594136ad14d4afb0ded383, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:07.029591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10617d-2b26-4c22-ad7e-a9bf2dbc1ed0 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:07.040552 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1431/2855] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:17:07 2022] PUT /identity/v3/projects/873452897b44473480203846b87b02e1/users/59a675b9da594136ad14d4afb0ded383/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:07.051313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b641fd8-e2e3-43e8-b2e9-cbf349b10bb6 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:07.054861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b641fd8-e2e3-43e8-b2e9-cbf349b10bb6 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:07.054861 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b641fd8-e2e3-43e8-b2e9-cbf349b10bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:07.080018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-8b641fd8-e2e3-43e8-b2e9-cbf349b10bb6 None None] MFA Rules not processed for user `59a675b9da594136ad14d4afb0ded383`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:07.081228 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8b641fd8-e2e3-43e8-b2e9-cbf349b10bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:07.152392 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1425/2856] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:07 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:07.163108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10617d-2b26-4c22-ad7e-a9bf2dbc1ed0 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:07.164899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-fe10617d-2b26-4c22-ad7e-a9bf2dbc1ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:07.222327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10617d-2b26-4c22-ad7e-a9bf2dbc1ed0 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:07.225938 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64666e29-b534-4277-9bda-67e7de3e377f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:07.226533 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64666e29-b534-4277-9bda-67e7de3e377f service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:07.226809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64666e29-b534-4277-9bda-67e7de3e377f service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:07.227078 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64666e29-b534-4277-9bda-67e7de3e377f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:07.236563 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64666e29-b534-4277-9bda-67e7de3e377f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:07.237999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64666e29-b534-4277-9bda-67e7de3e377f service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:07.247434 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1432/2857] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:07 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:07.565077 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b641fd8-e2e3-43e8-b2e9-cbf349b10bb6 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:07.574751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b641fd8-e2e3-43e8-b2e9-cbf349b10bb6 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:07.578304 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720f3ba-0600-4c3f-9613-f79b3421d943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:07.578920 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720f3ba-0600-4c3f-9613-f79b3421d943 service cinder] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:07.579199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720f3ba-0600-4c3f-9613-f79b3421d943 service cinder] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:07.579500 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720f3ba-0600-4c3f-9613-f79b3421d943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:07.635653 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720f3ba-0600-4c3f-9613-f79b3421d943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:07.637101 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720f3ba-0600-4c3f-9613-f79b3421d943 service cinder] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:07.646817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1426/2858] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:07 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:14.232661 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64666e29-b534-4277-9bda-67e7de3e377f service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:14.294409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64666e29-b534-4277-9bda-67e7de3e377f service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:14.298963 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:14.299620 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:14.299899 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:14.300167 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] PATH_INFO: `/v3/users/cf64c66a758f488fa2da8d9ef2d8e15c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:14.301271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf64c66a758f488fa2da8d9ef2d8e15c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:14.303201 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:14.305492 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:14.500409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf64c66a758f488fa2da8d9ef2d8e15c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:14.501556 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf64c66a758f488fa2da8d9ef2d8e15c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:14.508377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf64c66a758f488fa2da8d9ef2d8e15c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:14.583714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf64c66a758f488fa2da8d9ef2d8e15c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:14.596436 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf64c66a758f488fa2da8d9ef2d8e15c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:14.602641 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1433/2859] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:17:14 2022] DELETE /identity/v3/users/cf64c66a758f488fa2da8d9ef2d8e15c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:14.607358 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a1b99-a08d-444a-8d8f-d88ffd6a7af1 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:14.608977 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a1b99-a08d-444a-8d8f-d88ffd6a7af1 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:14.608977 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a1b99-a08d-444a-8d8f-d88ffd6a7af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:14.627409 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-7c7a1b99-a08d-444a-8d8f-d88ffd6a7af1 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:14.628625 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7c7a1b99-a08d-444a-8d8f-d88ffd6a7af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:14.686227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1427/2860] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:14.696493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:14.697893 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:14.754922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716c1a5-1471-46bd-81aa-9226342f1af9 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:14.758445 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940464d-0014-4e1f-a7e7-41f43587e602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:14.759042 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940464d-0014-4e1f-a7e7-41f43587e602 service neutron] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:14.759348 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940464d-0014-4e1f-a7e7-41f43587e602 service neutron] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:14.759623 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940464d-0014-4e1f-a7e7-41f43587e602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:14.768735 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940464d-0014-4e1f-a7e7-41f43587e602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:14.770171 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940464d-0014-4e1f-a7e7-41f43587e602 service neutron] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:14.779499 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1434/2861] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:15.237480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a1b99-a08d-444a-8d8f-d88ffd6a7af1 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:15.245974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-7c7a1b99-a08d-444a-8d8f-d88ffd6a7af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:15.251679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a1b99-a08d-444a-8d8f-d88ffd6a7af1 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:15.256820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:15.257456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:15.257738 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:15.258013 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] PATH_INFO: `/v3/projects/0b57865f56934e8ca8a22e4a8a6e23ac` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:15.259145 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b57865f56934e8ca8a22e4a8a6e23ac)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:15.261267 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:15.263137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=100 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:15.364636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b57865f56934e8ca8a22e4a8a6e23ac', 'request_id': 'req-3db96558-9966-4486-b24f-3500ef968e6c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.370731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b57865f56934e8ca8a22e4a8a6e23ac', 'request_id': 'req-3db96558-9966-4486-b24f-3500ef968e6c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.450406 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b57865f56934e8ca8a22e4a8a6e23ac', 'request_id': 'req-3db96558-9966-4486-b24f-3500ef968e6c'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.462258 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] The token cache is being invalidate because project 0b57865f56934e8ca8a22e4a8a6e23ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:17:15.462546 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.463167 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.464657 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1428/2862] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:17:15 2022] DELETE /identity/v3/projects/0b57865f56934e8ca8a22e4a8a6e23ac => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:15.468715 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940464d-0014-4e1f-a7e7-41f43587e602 service neutron] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:15.479433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940464d-0014-4e1f-a7e7-41f43587e602 service neutron] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:15.535985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:15.540252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:15.540252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:15.540252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] PATH_INFO: `/v3/users/59a675b9da594136ad14d4afb0ded383` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:15.540252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a675b9da594136ad14d4afb0ded383)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:15.540252 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:15.622567 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:15.716884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a675b9da594136ad14d4afb0ded383'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.717611 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a675b9da594136ad14d4afb0ded383'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.725475 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a675b9da594136ad14d4afb0ded383'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.790214 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a675b9da594136ad14d4afb0ded383'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.803374 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-a88e6e3d-5f67-4fad-b7b1-aed88e746ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a675b9da594136ad14d4afb0ded383'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:15.809675 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1435/2863] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:17:15 2022] DELETE /identity/v3/users/59a675b9da594136ad14d4afb0ded383 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:16.223698 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:16.225137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:16.238588 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db96558-9966-4486-b24f-3500ef968e6c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:16.296199 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:16.296825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:16.297103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:16.297376 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] PATH_INFO: `/v3/projects/873452897b44473480203846b87b02e1` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:16.299011 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873452897b44473480203846b87b02e1)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:16.300953 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:16.400029 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873452897b44473480203846b87b02e1', 'request_id': 'req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:16.406243 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873452897b44473480203846b87b02e1', 'request_id': 'req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:16.484686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873452897b44473480203846b87b02e1', 'request_id': 'req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:16.495505 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] The token cache is being invalidate because project 873452897b44473480203846b87b02e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:17:16.495791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:16.496520 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-c57ab4dc-231f-498e-adbc-82c4d6f0cf03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:16.497994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1429/2864] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:17:16 2022] DELETE /identity/v3/projects/873452897b44473480203846b87b02e1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:16.503616 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4af97-01d0-4e8a-89c4-641aa95fca57 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:16.507500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4af97-01d0-4e8a-89c4-641aa95fca57 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:16.507500 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4af97-01d0-4e8a-89c4-641aa95fca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:16.523814 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-a4b4af97-01d0-4e8a-89c4-641aa95fca57 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:16.525014 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-a4b4af97-01d0-4e8a-89c4-641aa95fca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:16.583156 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1436/2865] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:16.592449 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11946e3f-7624-4262-bc03-3ab8f15451c8 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:16.592938 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11946e3f-7624-4262-bc03-3ab8f15451c8 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:16.593217 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11946e3f-7624-4262-bc03-3ab8f15451c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:16.615301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-11946e3f-7624-4262-bc03-3ab8f15451c8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:16.617790 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-11946e3f-7624-4262-bc03-3ab8f15451c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:16.625687 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1430/2866] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:16.629992 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4af97-01d0-4e8a-89c4-641aa95fca57 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:16.639604 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4af97-01d0-4e8a-89c4-641aa95fca57 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:16.644336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2dca-6c1a-4c6b-86a2-2fb5cf51d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:16.644924 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2dca-6c1a-4c6b-86a2-2fb5cf51d503 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:16.645199 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2dca-6c1a-4c6b-86a2-2fb5cf51d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:16.645468 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2dca-6c1a-4c6b-86a2-2fb5cf51d503 admin admin] PATH_INFO: `/v3/domains` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:16.646106 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e2dca-6c1a-4c6b-86a2-2fb5cf51d503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93486) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:17:16.646405 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e2dca-6c1a-4c6b-86a2-2fb5cf51d503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:16.648028 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e2dca-6c1a-4c6b-86a2-2fb5cf51d503 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:16.660120 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1437/2867] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:17:16.664334 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11946e3f-7624-4262-bc03-3ab8f15451c8 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:16.674148 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11946e3f-7624-4262-bc03-3ab8f15451c8 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:16.678765 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c72ece-0232-406b-b605-0b2b529355d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:16.679445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c72ece-0232-406b-b605-0b2b529355d3 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:16.679726 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c72ece-0232-406b-b605-0b2b529355d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:16.679997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c72ece-0232-406b-b605-0b2b529355d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:16.680617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c72ece-0232-406b-b605-0b2b529355d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:16.682519 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c72ece-0232-406b-b605-0b2b529355d3 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:16.694084 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:16.808730 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1431/2868] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:17:16 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:17:16.812914 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2dca-6c1a-4c6b-86a2-2fb5cf51d503 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:16.823751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2dca-6c1a-4c6b-86a2-2fb5cf51d503 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:16.881440 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb874a5-74e2-462b-9cec-eb77be4e35b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:16.882038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb874a5-74e2-462b-9cec-eb77be4e35b2 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:16.882320 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb874a5-74e2-462b-9cec-eb77be4e35b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:16.882591 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb874a5-74e2-462b-9cec-eb77be4e35b2 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:16.883207 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb874a5-74e2-462b-9cec-eb77be4e35b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:16.885156 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb874a5-74e2-462b-9cec-eb77be4e35b2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.008414 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1438/2869] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:17:16 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:17.012707 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c72ece-0232-406b-b605-0b2b529355d3 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:17.024232 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c72ece-0232-406b-b605-0b2b529355d3 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:17.028975 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0d66-04ab-4733-acf9-0bdf2343517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:17.029549 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0d66-04ab-4733-acf9-0bdf2343517c admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.029842 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0d66-04ab-4733-acf9-0bdf2343517c admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.030109 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0d66-04ab-4733-acf9-0bdf2343517c admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.030749 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc0d66-04ab-4733-acf9-0bdf2343517c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:17.033186 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc0d66-04ab-4733-acf9-0bdf2343517c admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.043086 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1432/2870] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:17.046985 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb874a5-74e2-462b-9cec-eb77be4e35b2 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:17.057686 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb874a5-74e2-462b-9cec-eb77be4e35b2 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:17.062357 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ac6dc-a808-4f06-acd1-d2e1983e439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:17.062888 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ac6dc-a808-4f06-acd1-d2e1983e439a admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.063170 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ac6dc-a808-4f06-acd1-d2e1983e439a admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.064057 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ac6dc-a808-4f06-acd1-d2e1983e439a admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.064785 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ac6dc-a808-4f06-acd1-d2e1983e439a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:17.066387 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ac6dc-a808-4f06-acd1-d2e1983e439a admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.077978 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1439/2871] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:17.083197 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0d66-04ab-4733-acf9-0bdf2343517c admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:17.093344 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0d66-04ab-4733-acf9-0bdf2343517c admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:17.098968 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee83cc4-eb64-43e9-aa53-62595dbf425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:17.099652 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee83cc4-eb64-43e9-aa53-62595dbf425e admin admin] REQUEST_METHOD: `PUT` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.099955 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee83cc4-eb64-43e9-aa53-62595dbf425e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.100227 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee83cc4-eb64-43e9-aa53-62595dbf425e admin admin] PATH_INFO: `/v3/projects/36ffa1a17b014f4f987a573c5e0c5c75/users/15e669a4db974167920b95ef81fabb50/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.116670 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee83cc4-eb64-43e9-aa53-62595dbf425e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ffa1a17b014f4f987a573c5e0c5c75, user_id=15e669a4db974167920b95ef81fabb50, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:17.119567 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee83cc4-eb64-43e9-aa53-62595dbf425e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.189981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1433/2872] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:17:17 2022] PUT /identity/v3/projects/36ffa1a17b014f4f987a573c5e0c5c75/users/15e669a4db974167920b95ef81fabb50/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:17.200212 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb445-0aca-4043-9e58-a1671ae08b96 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.200496 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb445-0aca-4043-9e58-a1671ae08b96 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.200768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fb445-0aca-4043-9e58-a1671ae08b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.220849 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:17.229142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-f96fb445-0aca-4043-9e58-a1671ae08b96 None None] MFA Rules not processed for user `15e669a4db974167920b95ef81fabb50`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:17.233595 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-f96fb445-0aca-4043-9e58-a1671ae08b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:17.295121 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1440/2873] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:17.300205 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee83cc4-eb64-43e9-aa53-62595dbf425e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:17.359961 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee83cc4-eb64-43e9-aa53-62595dbf425e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:17.365040 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ccd50-45d1-40ac-aad6-04daff235f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:17.365636 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ccd50-45d1-40ac-aad6-04daff235f82 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.365933 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ccd50-45d1-40ac-aad6-04daff235f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.366179 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ccd50-45d1-40ac-aad6-04daff235f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.366793 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ccd50-45d1-40ac-aad6-04daff235f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:17.368715 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ccd50-45d1-40ac-aad6-04daff235f82 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.448679 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1434/2874] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:17:17 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:17.452731 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb445-0aca-4043-9e58-a1671ae08b96 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:17.464210 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fb445-0aca-4043-9e58-a1671ae08b96 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:17.521395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82239a-0615-4a5f-b1c2-e4cb93b4c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:17.522010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82239a-0615-4a5f-b1c2-e4cb93b4c3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.522272 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82239a-0615-4a5f-b1c2-e4cb93b4c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.522534 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82239a-0615-4a5f-b1c2-e4cb93b4c3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.523147 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82239a-0615-4a5f-b1c2-e4cb93b4c3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:17.525104 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82239a-0615-4a5f-b1c2-e4cb93b4c3d2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.602019 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1441/2875] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:17:17 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:17.606048 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ccd50-45d1-40ac-aad6-04daff235f82 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:17.617184 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ccd50-45d1-40ac-aad6-04daff235f82 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:17.621755 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4cd35-2b13-410b-9aae-d688f4443a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:17.622352 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4cd35-2b13-410b-9aae-d688f4443a60 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.622628 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4cd35-2b13-410b-9aae-d688f4443a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.622897 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4cd35-2b13-410b-9aae-d688f4443a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.623591 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4cd35-2b13-410b-9aae-d688f4443a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:17.625448 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4cd35-2b13-410b-9aae-d688f4443a60 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.636806 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1435/2876] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:17.641219 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82239a-0615-4a5f-b1c2-e4cb93b4c3d2 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:17.651896 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82239a-0615-4a5f-b1c2-e4cb93b4c3d2 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:17.656903 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9dd03-5284-4576-b9a0-e54619542bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:17.657209 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9dd03-5284-4576-b9a0-e54619542bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.657502 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9dd03-5284-4576-b9a0-e54619542bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.657766 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9dd03-5284-4576-b9a0-e54619542bd9 admin admin] PATH_INFO: `/v3/projects/418548987c4f4e20b0f1da9c985db08c/users/44c263763f9a470d8a4f2859ac6fb862/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.674367 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9dd03-5284-4576-b9a0-e54619542bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418548987c4f4e20b0f1da9c985db08c, user_id=44c263763f9a470d8a4f2859ac6fb862, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:17.677095 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9dd03-5284-4576-b9a0-e54619542bd9 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.765142 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1442/2877] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:17:17 2022] PUT /identity/v3/projects/418548987c4f4e20b0f1da9c985db08c/users/44c263763f9a470d8a4f2859ac6fb862/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:17.769342 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4cd35-2b13-410b-9aae-d688f4443a60 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:17.779312 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4cd35-2b13-410b-9aae-d688f4443a60 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:17.836198 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4a15d-650f-4fb1-a5b1-a9eec420c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:17.836804 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4a15d-650f-4fb1-a5b1-a9eec420c1aa admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.837081 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4a15d-650f-4fb1-a5b1-a9eec420c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.837351 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4a15d-650f-4fb1-a5b1-a9eec420c1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.837989 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4a15d-650f-4fb1-a5b1-a9eec420c1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:17.839624 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4a15d-650f-4fb1-a5b1-a9eec420c1aa admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.850574 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1436/2878] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:17:17.854809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9dd03-5284-4576-b9a0-e54619542bd9 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:17.866087 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9dd03-5284-4576-b9a0-e54619542bd9 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:17.872793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6b7f8-24d4-455a-ba1a-5f8ebc5b8e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:17.872793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b7f8-24d4-455a-ba1a-5f8ebc5b8e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.872793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b7f8-24d4-455a-ba1a-5f8ebc5b8e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.872793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6b7f8-24d4-455a-ba1a-5f8ebc5b8e0d admin admin] PATH_INFO: `/v3/projects/418548987c4f4e20b0f1da9c985db08c/users/44c263763f9a470d8a4f2859ac6fb862/roles/9ec7f759c0a64655b794dfb597930076` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.874054 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6b7f8-24d4-455a-ba1a-5f8ebc5b8e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=418548987c4f4e20b0f1da9c985db08c, user_id=44c263763f9a470d8a4f2859ac6fb862, role_id=9ec7f759c0a64655b794dfb597930076)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:17.877564 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6b7f8-24d4-455a-ba1a-5f8ebc5b8e0d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:17.887965 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1443/2879] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:17:17 2022] PUT /identity/v3/projects/418548987c4f4e20b0f1da9c985db08c/users/44c263763f9a470d8a4f2859ac6fb862/roles/9ec7f759c0a64655b794dfb597930076 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:17.898834 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda01e3-7ee8-428f-8b02-e5ba8dfeb699 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:17.901514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda01e3-7ee8-428f-8b02-e5ba8dfeb699 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:17.901514 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda01e3-7ee8-428f-8b02-e5ba8dfeb699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:17.927626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-4fda01e3-7ee8-428f-8b02-e5ba8dfeb699 None None] MFA Rules not processed for user `44c263763f9a470d8a4f2859ac6fb862`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:17.928912 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4fda01e3-7ee8-428f-8b02-e5ba8dfeb699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:17.942338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:17.999682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1437/2880] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:17:18.011022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6b7f8-24d4-455a-ba1a-5f8ebc5b8e0d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:18.012733 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-88a6b7f8-24d4-455a-ba1a-5f8ebc5b8e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:18.071149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6b7f8-24d4-455a-ba1a-5f8ebc5b8e0d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:18.074793 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f5e76-d546-4bb7-a1c0-9bcd76c36b61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:18.075426 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f5e76-d546-4bb7-a1c0-9bcd76c36b61 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:18.075701 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f5e76-d546-4bb7-a1c0-9bcd76c36b61 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:18.075966 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f5e76-d546-4bb7-a1c0-9bcd76c36b61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:18.080265 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:18.134493 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f5e76-d546-4bb7-a1c0-9bcd76c36b61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:18.135902 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f5e76-d546-4bb7-a1c0-9bcd76c36b61 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:18.144928 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1444/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:19.400648 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda01e3-7ee8-428f-8b02-e5ba8dfeb699 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:19.402076 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-4fda01e3-7ee8-428f-8b02-e5ba8dfeb699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:19.494754 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda01e3-7ee8-428f-8b02-e5ba8dfeb699 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:19.500093 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbbd5c-31dc-4997-a423-1f60d7801fc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:19.500696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbbd5c-31dc-4997-a423-1f60d7801fc7 service placement] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:19.500972 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbbd5c-31dc-4997-a423-1f60d7801fc7 service placement] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:19.501355 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbbd5c-31dc-4997-a423-1f60d7801fc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:19.503150 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c7bbbd5c-31dc-4997-a423-1f60d7801fc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:19.514762 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbbd5c-31dc-4997-a423-1f60d7801fc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:19.516373 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbbd5c-31dc-4997-a423-1f60d7801fc7 service placement] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:19.526496 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1438/2882] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:23.228247 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f5e76-d546-4bb7-a1c0-9bcd76c36b61 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:23.229666 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-997f5e76-d546-4bb7-a1c0-9bcd76c36b61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:23.241713 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f5e76-d546-4bb7-a1c0-9bcd76c36b61 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:23.245304 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f7226-cbc5-4a45-82ca-12997386491f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:23.245890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f7226-cbc5-4a45-82ca-12997386491f service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:23.246165 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f7226-cbc5-4a45-82ca-12997386491f service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:23.246433 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f7226-cbc5-4a45-82ca-12997386491f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:23.255457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f7226-cbc5-4a45-82ca-12997386491f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:23.256910 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f7226-cbc5-4a45-82ca-12997386491f service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:23.266159 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1445/2883] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:29.065530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbbd5c-31dc-4997-a423-1f60d7801fc7 service placement] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:29.129452 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbbd5c-31dc-4997-a423-1f60d7801fc7 service placement] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:29.134035 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:29.135110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:29.135110 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:29.135387 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] PATH_INFO: `/v3/users/15e669a4db974167920b95ef81fabb50` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:29.136483 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e669a4db974167920b95ef81fabb50)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:29.138389 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:29.161967 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:29.421277 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e669a4db974167920b95ef81fabb50'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:29.422126 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e669a4db974167920b95ef81fabb50'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:29.509393 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e669a4db974167920b95ef81fabb50'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:29.516852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e669a4db974167920b95ef81fabb50'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:29.529185 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e669a4db974167920b95ef81fabb50'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:29.534922 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1439/2884] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:17:29 2022] DELETE /identity/v3/users/15e669a4db974167920b95ef81fabb50 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:29.540250 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775d810-166d-4c54-921c-bc78a4c6e1c8 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:29.540739 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775d810-166d-4c54-921c-bc78a4c6e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:29.540852 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775d810-166d-4c54-921c-bc78a4c6e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:29.559597 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-b775d810-166d-4c54-921c-bc78a4c6e1c8 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:29.560795 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b775d810-166d-4c54-921c-bc78a4c6e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:29.632765 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1446/2885] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:29.643313 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:29.653921 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:29.702798 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f83dd-be4b-4f30-bb6f-b4856a72f79e admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:29.706445 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48240e4-cba5-452a-883d-fb4c5caa1fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:29.707881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48240e4-cba5-452a-883d-fb4c5caa1fba service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:29.708161 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48240e4-cba5-452a-883d-fb4c5caa1fba service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:29.708450 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48240e4-cba5-452a-883d-fb4c5caa1fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:29.717487 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48240e4-cba5-452a-883d-fb4c5caa1fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:29.718909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48240e4-cba5-452a-883d-fb4c5caa1fba service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:29.730831 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1440/2886] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:30.128342 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775d810-166d-4c54-921c-bc78a4c6e1c8 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:30.130362 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-b775d810-166d-4c54-921c-bc78a4c6e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:30.147886 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775d810-166d-4c54-921c-bc78a4c6e1c8 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:30.153678 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:30.154636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:30.155011 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:30.155516 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] PATH_INFO: `/v3/projects/36ffa1a17b014f4f987a573c5e0c5c75` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:30.159117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ffa1a17b014f4f987a573c5e0c5c75)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:30.159117 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:30.257883 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ffa1a17b014f4f987a573c5e0c5c75', 'request_id': 'req-d5ff31ba-3202-4de1-b3a6-873fc6f54760'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.263395 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ffa1a17b014f4f987a573c5e0c5c75', 'request_id': 'req-d5ff31ba-3202-4de1-b3a6-873fc6f54760'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.270066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ffa1a17b014f4f987a573c5e0c5c75', 'request_id': 'req-d5ff31ba-3202-4de1-b3a6-873fc6f54760'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.354467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] The token cache is being invalidate because project 36ffa1a17b014f4f987a573c5e0c5c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:17:30.354758 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.355418 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.356917 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1447/2887] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:17:30 2022] DELETE /identity/v3/projects/36ffa1a17b014f4f987a573c5e0c5c75 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:30.361348 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48240e4-cba5-452a-883d-fb4c5caa1fba service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:30.371488 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48240e4-cba5-452a-883d-fb4c5caa1fba service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:30.429078 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:30.429704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:30.429981 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:30.430254 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] PATH_INFO: `/v3/users/44c263763f9a470d8a4f2859ac6fb862` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:30.431417 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c263763f9a470d8a4f2859ac6fb862)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:30.433338 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:30.658740 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:30.660851 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c263763f9a470d8a4f2859ac6fb862'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.661647 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c263763f9a470d8a4f2859ac6fb862'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.724623 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c263763f9a470d8a4f2859ac6fb862'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.732600 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c263763f9a470d8a4f2859ac6fb862'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.745681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-0604c8fd-2391-44c9-b4c5-eca7ff6ad765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c263763f9a470d8a4f2859ac6fb862'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:30.751617 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1441/2888] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:17:30 2022] DELETE /identity/v3/users/44c263763f9a470d8a4f2859ac6fb862 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:31.151854 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:31.153566 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:31.168700 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff31ba-3202-4de1-b3a6-873fc6f54760 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:31.181774 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:31.228446 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:31.229112 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:31.229391 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:31.229660 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] PATH_INFO: `/v3/projects/418548987c4f4e20b0f1da9c985db08c` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:31.230779 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] RBAC: Authorizing `identity:delete_project(project_id=418548987c4f4e20b0f1da9c985db08c)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:31.232911 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:31.332833 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418548987c4f4e20b0f1da9c985db08c', 'request_id': 'req-692a80ed-6b58-4510-ac14-5d14f043633c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:31.338341 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418548987c4f4e20b0f1da9c985db08c', 'request_id': 'req-692a80ed-6b58-4510-ac14-5d14f043633c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:31.344377 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418548987c4f4e20b0f1da9c985db08c', 'request_id': 'req-692a80ed-6b58-4510-ac14-5d14f043633c'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:31.417676 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] The token cache is being invalidate because project 418548987c4f4e20b0f1da9c985db08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:17:31.417971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:31.418610 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-692a80ed-6b58-4510-ac14-5d14f043633c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:31.420141 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1448/2889] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:17:31 2022] DELETE /identity/v3/projects/418548987c4f4e20b0f1da9c985db08c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:31.426201 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3f32-ee6f-4b56-8afe-a6579c4e45c6 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:31.426708 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3f32-ee6f-4b56-8afe-a6579c4e45c6 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:31.426828 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3f32-ee6f-4b56-8afe-a6579c4e45c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:31.446817 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ad7c3f32-ee6f-4b56-8afe-a6579c4e45c6 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:31.448135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ad7c3f32-ee6f-4b56-8afe-a6579c4e45c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:31.507778 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1442/2890] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:31.517227 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38bd09-359e-4b5d-a566-ff6aa27ae476 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:31.517514 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38bd09-359e-4b5d-a566-ff6aa27ae476 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:31.517787 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38bd09-359e-4b5d-a566-ff6aa27ae476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:31.538017 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-eb38bd09-359e-4b5d-a566-ff6aa27ae476 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:31.539248 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-eb38bd09-359e-4b5d-a566-ff6aa27ae476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:31.547079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1449/2891] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:31.551427 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c3f32-ee6f-4b56-8afe-a6579c4e45c6 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:31.561032 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c3f32-ee6f-4b56-8afe-a6579c4e45c6 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:31.565541 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b151e5-dac0-4dcc-b2be-44841d2c3a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:31.566137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b151e5-dac0-4dcc-b2be-44841d2c3a75 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:31.566954 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b151e5-dac0-4dcc-b2be-44841d2c3a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:31.567301 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b151e5-dac0-4dcc-b2be-44841d2c3a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:31.567973 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b151e5-dac0-4dcc-b2be-44841d2c3a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:17:31.568272 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b151e5-dac0-4dcc-b2be-44841d2c3a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:31.569908 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b151e5-dac0-4dcc-b2be-44841d2c3a75 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:31.581169 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1443/2892] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:17:31.586276 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38bd09-359e-4b5d-a566-ff6aa27ae476 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:31.595813 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38bd09-359e-4b5d-a566-ff6aa27ae476 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:31.600809 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83189b-089c-4797-868c-7c625e96bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:31.601401 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83189b-089c-4797-868c-7c625e96bcfc admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:31.601679 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83189b-089c-4797-868c-7c625e96bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:31.601954 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83189b-089c-4797-868c-7c625e96bcfc admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:31.602579 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83189b-089c-4797-868c-7c625e96bcfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:31.604529 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83189b-089c-4797-868c-7c625e96bcfc admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:31.740244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1450/2893] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:17:31 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:31.744571 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b151e5-dac0-4dcc-b2be-44841d2c3a75 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:31.755477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b151e5-dac0-4dcc-b2be-44841d2c3a75 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:31.811135 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9093a-27cf-4c76-9881-cf83bb65fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:31.811768 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9093a-27cf-4c76-9881-cf83bb65fff4 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:31.812047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9093a-27cf-4c76-9881-cf83bb65fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:31.812320 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9093a-27cf-4c76-9881-cf83bb65fff4 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:31.812942 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9093a-27cf-4c76-9881-cf83bb65fff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:31.814871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9093a-27cf-4c76-9881-cf83bb65fff4 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:31.918799 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1444/2894] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:17:31 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:31.922987 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83189b-089c-4797-868c-7c625e96bcfc admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:31.934135 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83189b-089c-4797-868c-7c625e96bcfc admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:31.940101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964b241-9961-46bf-945d-be457bccb0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:31.940101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964b241-9961-46bf-945d-be457bccb0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:31.940101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964b241-9961-46bf-945d-be457bccb0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:31.940101 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964b241-9961-46bf-945d-be457bccb0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:31.940537 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964b241-9961-46bf-945d-be457bccb0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:31.943086 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964b241-9961-46bf-945d-be457bccb0d2 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:31.953022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1451/2895] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:31.956994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9093a-27cf-4c76-9881-cf83bb65fff4 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:31.967403 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9093a-27cf-4c76-9881-cf83bb65fff4 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:31.972341 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebc436-9d69-4ece-8cac-2e0a95c604a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:31.973204 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc436-9d69-4ece-8cac-2e0a95c604a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:31.973570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc436-9d69-4ece-8cac-2e0a95c604a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:31.973844 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc436-9d69-4ece-8cac-2e0a95c604a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:31.974498 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebc436-9d69-4ece-8cac-2e0a95c604a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:31.976132 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebc436-9d69-4ece-8cac-2e0a95c604a0 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:31.986720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1445/2896] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:31.991283 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964b241-9961-46bf-945d-be457bccb0d2 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:32.001659 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964b241-9961-46bf-945d-be457bccb0d2 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:32.007012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c5aa-14a5-46e9-a54f-c18f32a7c559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:32.007688 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c5aa-14a5-46e9-a54f-c18f32a7c559 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:32.007971 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c5aa-14a5-46e9-a54f-c18f32a7c559 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:32.008269 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c5aa-14a5-46e9-a54f-c18f32a7c559 admin admin] PATH_INFO: `/v3/projects/20d08e2c6a55432ba2003ddf57b1a7e4/users/e5fe35a4bdb04627924e8f2163346a88/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:32.022866 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c5aa-14a5-46e9-a54f-c18f32a7c559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d08e2c6a55432ba2003ddf57b1a7e4, user_id=e5fe35a4bdb04627924e8f2163346a88, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:32.025559 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c5aa-14a5-46e9-a54f-c18f32a7c559 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:32.120181 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1452/2897] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:17:31 2022] PUT /identity/v3/projects/20d08e2c6a55432ba2003ddf57b1a7e4/users/e5fe35a4bdb04627924e8f2163346a88/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:32.131822 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a6ff3-9d51-4ff5-9358-5ebf2dcf2f5d None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:32.132158 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a6ff3-9d51-4ff5-9358-5ebf2dcf2f5d None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:32.132436 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a6ff3-9d51-4ff5-9358-5ebf2dcf2f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:32.161318 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-c70a6ff3-9d51-4ff5-9358-5ebf2dcf2f5d None None] MFA Rules not processed for user `e5fe35a4bdb04627924e8f2163346a88`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:32.162570 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-c70a6ff3-9d51-4ff5-9358-5ebf2dcf2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:32.179937 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:32.228057 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1446/2898] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:32.242695 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c5aa-14a5-46e9-a54f-c18f32a7c559 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:32.244696 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-2f00c5aa-14a5-46e9-a54f-c18f32a7c559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:32.290281 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:32.302204 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c5aa-14a5-46e9-a54f-c18f32a7c559 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:32.305837 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c4d14-afed-4ca9-a294-6101a7f6f706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:32.306432 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c4d14-afed-4ca9-a294-6101a7f6f706 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:32.306706 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c4d14-afed-4ca9-a294-6101a7f6f706 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:32.306973 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c4d14-afed-4ca9-a294-6101a7f6f706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:32.315071 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c4d14-afed-4ca9-a294-6101a7f6f706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:32.316580 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c4d14-afed-4ca9-a294-6101a7f6f706 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:32.325927 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1453/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:42.266930 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=19 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:42.380999 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=7 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:49.214969 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a6ff3-9d51-4ff5-9358-5ebf2dcf2f5d None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:49.277923 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a6ff3-9d51-4ff5-9358-5ebf2dcf2f5d None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:49.282460 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:49.283092 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:49.283408 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:49.283686 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] PATH_INFO: `/v3/users/e5fe35a4bdb04627924e8f2163346a88` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:49.284818 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fe35a4bdb04627924e8f2163346a88)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:49.286838 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:49.465634 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fe35a4bdb04627924e8f2163346a88'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:49.466294 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fe35a4bdb04627924e8f2163346a88'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:49.520064 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fe35a4bdb04627924e8f2163346a88'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:49.527517 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fe35a4bdb04627924e8f2163346a88'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:49.540095 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fe35a4bdb04627924e8f2163346a88'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:49.545994 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1447/2900] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:17:49 2022] DELETE /identity/v3/users/e5fe35a4bdb04627924e8f2163346a88 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:49.550648 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c226f-565c-4146-bfe5-b46f52154350 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:49.551108 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c226f-565c-4146-bfe5-b46f52154350 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:49.551244 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c226f-565c-4146-bfe5-b46f52154350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:49.570365 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-595c226f-565c-4146-bfe5-b46f52154350 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:49.572606 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-595c226f-565c-4146-bfe5-b46f52154350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:49.633935 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1454/2901] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:49.643682 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:49.645071 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:49.724017 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424ece6-3012-42ca-87e8-7c307dd51ced admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:49.727911 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a443f-29e5-4b12-a027-9faba8270ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:49.728515 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a443f-29e5-4b12-a027-9faba8270ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:49.728797 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a443f-29e5-4b12-a027-9faba8270ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:49.729070 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a443f-29e5-4b12-a027-9faba8270ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:49.738074 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a443f-29e5-4b12-a027-9faba8270ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:49.739547 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a443f-29e5-4b12-a027-9faba8270ad8 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:49.750477 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1448/2902] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:50.153968 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c226f-565c-4146-bfe5-b46f52154350 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:50.156149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-595c226f-565c-4146-bfe5-b46f52154350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:50.167843 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c226f-565c-4146-bfe5-b46f52154350 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:50.172632 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:50.173307 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:50.173584 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:50.173853 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] PATH_INFO: `/v3/projects/20d08e2c6a55432ba2003ddf57b1a7e4` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:50.175026 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d08e2c6a55432ba2003ddf57b1a7e4)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:50.176980 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:50.293427 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d08e2c6a55432ba2003ddf57b1a7e4', 'request_id': 'req-5f074fb2-541b-42f8-8780-53d26696f4a9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:50.298945 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d08e2c6a55432ba2003ddf57b1a7e4', 'request_id': 'req-5f074fb2-541b-42f8-8780-53d26696f4a9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:50.305236 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d08e2c6a55432ba2003ddf57b1a7e4', 'request_id': 'req-5f074fb2-541b-42f8-8780-53d26696f4a9'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:50.386467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] The token cache is being invalidate because project 20d08e2c6a55432ba2003ddf57b1a7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:17:50.386794 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:50.387456 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-5f074fb2-541b-42f8-8780-53d26696f4a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:17:50.388948 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1455/2903] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:17:50 2022] DELETE /identity/v3/projects/20d08e2c6a55432ba2003ddf57b1a7e4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:50.394314 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f3dc4-642d-4d17-b55f-38bc6f2e0627 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:50.394785 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f3dc4-642d-4d17-b55f-38bc6f2e0627 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:50.394901 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f3dc4-642d-4d17-b55f-38bc6f2e0627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:50.403120 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:50.416088 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-5e0f3dc4-642d-4d17-b55f-38bc6f2e0627 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:50.417282 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-5e0f3dc4-642d-4d17-b55f-38bc6f2e0627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:50.475863 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1449/2904] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:50.485609 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694d12-e697-498d-bf64-57d2ada86321 None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:50.485890 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694d12-e697-498d-bf64-57d2ada86321 None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:50.486160 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694d12-e697-498d-bf64-57d2ada86321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:50.505462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-7a694d12-e697-498d-bf64-57d2ada86321 None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:50.506654 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7a694d12-e697-498d-bf64-57d2ada86321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:50.514548 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1456/2905] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:50.518820 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f3dc4-642d-4d17-b55f-38bc6f2e0627 None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:50.529043 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f3dc4-642d-4d17-b55f-38bc6f2e0627 None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:50.533558 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4a1fc-a74e-4c3e-b9d5-25ef0c348c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:50.534156 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4a1fc-a74e-4c3e-b9d5-25ef0c348c76 admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:50.534430 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4a1fc-a74e-4c3e-b9d5-25ef0c348c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:50.534696 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4a1fc-a74e-4c3e-b9d5-25ef0c348c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:50.535402 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4a1fc-a74e-4c3e-b9d5-25ef0c348c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:17:50.535702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4a1fc-a74e-4c3e-b9d5-25ef0c348c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:50.537278 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4a1fc-a74e-4c3e-b9d5-25ef0c348c76 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:50.549491 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1450/2906] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Aug 22 20:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:17:50.553683 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a694d12-e697-498d-bf64-57d2ada86321 None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:50.563530 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a694d12-e697-498d-bf64-57d2ada86321 None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:50.568428 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32857528-fe18-4bcc-ae4d-465d4b4a9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:50.569025 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32857528-fe18-4bcc-ae4d-465d4b4a9841 admin admin] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:50.569302 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32857528-fe18-4bcc-ae4d-465d4b4a9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:50.569573 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32857528-fe18-4bcc-ae4d-465d4b4a9841 admin admin] PATH_INFO: `/v3/projects` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:50.570520 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32857528-fe18-4bcc-ae4d-465d4b4a9841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:50.572472 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32857528-fe18-4bcc-ae4d-465d4b4a9841 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:50.656425 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1457/2907] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Aug 22 20:17:50 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:50.660702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4a1fc-a74e-4c3e-b9d5-25ef0c348c76 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:50.671187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4a1fc-a74e-4c3e-b9d5-25ef0c348c76 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:50.728103 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8eb13-589c-48e5-aa56-e014367bdcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:50.728704 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8eb13-589c-48e5-aa56-e014367bdcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:50.728978 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8eb13-589c-48e5-aa56-e014367bdcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:50.729246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8eb13-589c-48e5-aa56-e014367bdcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:50.729871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8eb13-589c-48e5-aa56-e014367bdcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:50.731814 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8eb13-589c-48e5-aa56-e014367bdcc7 admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:50.828429 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1451/2908] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Aug 22 20:17:50 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:17:50.832449 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32857528-fe18-4bcc-ae4d-465d4b4a9841 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:50.843067 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32857528-fe18-4bcc-ae4d-465d4b4a9841 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:50.847982 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b81a8-a584-4cce-ae17-a7655a441e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:50.848571 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b81a8-a584-4cce-ae17-a7655a441e4d admin admin] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:50.848848 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b81a8-a584-4cce-ae17-a7655a441e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:50.849116 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b81a8-a584-4cce-ae17-a7655a441e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:50.849748 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b81a8-a584-4cce-ae17-a7655a441e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:50.852081 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b81a8-a584-4cce-ae17-a7655a441e4d admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:50.861821 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1458/2909] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:50.865702 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8eb13-589c-48e5-aa56-e014367bdcc7 admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:50.876530 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8eb13-589c-48e5-aa56-e014367bdcc7 admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:50.881122 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90032d41-c997-4cc4-a3c5-41bd00ba5a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:50.881713 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90032d41-c997-4cc4-a3c5-41bd00ba5a2e admin admin] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:50.881996 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90032d41-c997-4cc4-a3c5-41bd00ba5a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:50.882268 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90032d41-c997-4cc4-a3c5-41bd00ba5a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:50.883345 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90032d41-c997-4cc4-a3c5-41bd00ba5a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:50.884965 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90032d41-c997-4cc4-a3c5-41bd00ba5a2e admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:50.896626 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1452/2910] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Aug 22 20:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:17:50.900699 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b81a8-a584-4cce-ae17-a7655a441e4d admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:50.910745 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b81a8-a584-4cce-ae17-a7655a441e4d admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:50.915947 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414555c-b8b5-4bfa-bfc8-d201697cb379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:50.916583 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414555c-b8b5-4bfa-bfc8-d201697cb379 admin admin] REQUEST_METHOD: `PUT` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:50.916858 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414555c-b8b5-4bfa-bfc8-d201697cb379 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:50.917128 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414555c-b8b5-4bfa-bfc8-d201697cb379 admin admin] PATH_INFO: `/v3/projects/df531b80519644d989fbe3319c8d2f0d/users/3b95c070ebb2452fbc7dbf76c55317c3/roles/62d0acf1402140c5a97def31e7b912c7` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:50.932084 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414555c-b8b5-4bfa-bfc8-d201697cb379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df531b80519644d989fbe3319c8d2f0d, user_id=3b95c070ebb2452fbc7dbf76c55317c3, role_id=62d0acf1402140c5a97def31e7b912c7)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:50.934790 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414555c-b8b5-4bfa-bfc8-d201697cb379 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:50.999951 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1459/2911] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Aug 22 20:17:50 2022] PUT /identity/v3/projects/df531b80519644d989fbe3319c8d2f0d/users/3b95c070ebb2452fbc7dbf76c55317c3/roles/62d0acf1402140c5a97def31e7b912c7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:17:51.010587 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7c62f-64ca-4875-b661-0d6bdb113970 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:51.010871 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7c62f-64ca-4875-b661-0d6bdb113970 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:51.011144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7c62f-64ca-4875-b661-0d6bdb113970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:51.039767 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-f9a7c62f-64ca-4875-b661-0d6bdb113970 None None] MFA Rules not processed for user `3b95c070ebb2452fbc7dbf76c55317c3`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:51.043849 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f9a7c62f-64ca-4875-b661-0d6bdb113970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:51.101136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:51.106832 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1453/2912] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:17:51.117804 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414555c-b8b5-4bfa-bfc8-d201697cb379 admin admin] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:17:51.121010 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-8414555c-b8b5-4bfa-bfc8-d201697cb379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:51.142278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:17:51.209413 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414555c-b8b5-4bfa-bfc8-d201697cb379 admin admin] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:17:51.213730 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b830a-490e-4894-9a4c-810982eb0169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2422c781c74f44ae83e8b094f1728743', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:17:51.214327 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b830a-490e-4894-9a4c-810982eb0169 service cinder] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:51.214605 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b830a-490e-4894-9a4c-810982eb0169 service cinder] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:51.214875 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b830a-490e-4894-9a4c-810982eb0169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:51.223581 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b830a-490e-4894-9a4c-810982eb0169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:17:51.225012 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b830a-490e-4894-9a4c-810982eb0169 service cinder] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:17:51.234780 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1460/2913] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:17:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:17:52.902667 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823fafa-baa0-4950-a649-82cad80cfdd2 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:17:52.903215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823fafa-baa0-4950-a649-82cad80cfdd2 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:17:52.903215 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823fafa-baa0-4950-a649-82cad80cfdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:17:52.923681 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-b823fafa-baa0-4950-a649-82cad80cfdd2 None None] MFA Rules not processed for user `3b95c070ebb2452fbc7dbf76c55317c3`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:17:52.924881 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-b823fafa-baa0-4950-a649-82cad80cfdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:17:52.932303 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1454/2914] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:17:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:18:01.320303 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=26 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:18:02.918478 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=4 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:18:04.673082 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b830a-490e-4894-9a4c-810982eb0169 service cinder] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:18:04.674497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-cf7b830a-490e-4894-9a4c-810982eb0169 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:04.757047 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b830a-490e-4894-9a4c-810982eb0169 service cinder] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:18:04.763185 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1787fcb6f7c34de59c9682a4d8c3d2a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:18:04.763922 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:04.764196 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:04.764457 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:04.766175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:04.778608 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:18:04.781048 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:18:04.792994 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1461/2915] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:18:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:18:11.642018 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea0dc-1f25-4dac-a996-dc7ab8c301aa None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:11.642495 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea0dc-1f25-4dac-a996-dc7ab8c301aa None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:11.642611 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea0dc-1f25-4dac-a996-dc7ab8c301aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:11.700896 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-03fea0dc-1f25-4dac-a996-dc7ab8c301aa None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:18:11.702181 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-03fea0dc-1f25-4dac-a996-dc7ab8c301aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:11.765006 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1455/2916] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 20:18:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:18:11.915831 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:18:11.917241 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:12.006724 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639015c-8d8f-4b87-92f0-cf4776e07350 service nova] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:18:12.011741 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ade18-62c2-4565-83af-30cc6cb9a399 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:18:12.012336 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ade18-62c2-4565-83af-30cc6cb9a399 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:12.012615 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ade18-62c2-4565-83af-30cc6cb9a399 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:12.012887 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ade18-62c2-4565-83af-30cc6cb9a399 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:12.021131 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ade18-62c2-4565-83af-30cc6cb9a399 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:18:12.022714 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ade18-62c2-4565-83af-30cc6cb9a399 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:18:12.031246 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1462/2917] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:18:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:18:12.851192 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f44af-fbb2-43b2-a965-0fb8d7410137 None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:12.851689 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f44af-fbb2-43b2-a965-0fb8d7410137 None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:12.851791 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f44af-fbb2-43b2-a965-0fb8d7410137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:12.872288 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-777f44af-fbb2-43b2-a965-0fb8d7410137 None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:18:12.874075 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-777f44af-fbb2-43b2-a965-0fb8d7410137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:12.881144 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1456/2918] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 20:18:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:18:12.894931 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ade18-62c2-4565-83af-30cc6cb9a399 service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:18:12.906217 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ade18-62c2-4565-83af-30cc6cb9a399 service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:18:12.911115 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e16db-5d27-4bd3-89dc-d63f9cbc1aa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:18:12.911753 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e16db-5d27-4bd3-89dc-d63f9cbc1aa3 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:12.912022 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e16db-5d27-4bd3-89dc-d63f9cbc1aa3 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:12.912288 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e16db-5d27-4bd3-89dc-d63f9cbc1aa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:12.920990 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e16db-5d27-4bd3-89dc-d63f9cbc1aa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:18:12.922602 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e16db-5d27-4bd3-89dc-d63f9cbc1aa3 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:18:12.930643 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1463/2919] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:18:13.506264 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4d53e-3ba3-4e0d-83ce-466c2d60fe1a None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:13.506576 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4d53e-3ba3-4e0d-83ce-466c2d60fe1a None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:13.506850 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4d53e-3ba3-4e0d-83ce-466c2d60fe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:13.525422 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-03e4d53e-3ba3-4e0d-83ce-466c2d60fe1a None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:18:13.526596 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-03e4d53e-3ba3-4e0d-83ce-466c2d60fe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:13.534060 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1457/2920] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Aug 22 20:18:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:18:13.546220 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e16db-5d27-4bd3-89dc-d63f9cbc1aa3 service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:18:13.556855 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e16db-5d27-4bd3-89dc-d63f9cbc1aa3 service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:18:13.561962 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e3479-84cc-4ba4-8481-189b76572a83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:18:13.562535 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3479-84cc-4ba4-8481-189b76572a83 service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:13.562810 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3479-84cc-4ba4-8481-189b76572a83 service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:13.563079 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3479-84cc-4ba4-8481-189b76572a83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:13.571125 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e3479-84cc-4ba4-8481-189b76572a83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:18:13.572738 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e3479-84cc-4ba4-8481-189b76572a83 service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:18:13.580767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1464/2921] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:18:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:18:14.166590 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b45d2-dc08-4247-814a-b0cc1b3f4d8c None None] REQUEST_METHOD: `POST` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:14.167056 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b45d2-dc08-4247-814a-b0cc1b3f4d8c None None] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:14.167173 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b45d2-dc08-4247-814a-b0cc1b3f4d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:14.186609 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.auth.core [None req-ef9b45d2-dc08-4247-814a-b0cc1b3f4d8c None None] MFA Rules not processed for user `2e09e41723f5430aad58bbca945d1447`. Rule list: `[]` (Enabled: `True`). {{(pid=93485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:18:14.188047 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-ef9b45d2-dc08-4247-814a-b0cc1b3f4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:14.195162 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1458/2922] 10.222.0.18 () {58 vars in 967 bytes} [Mon Aug 22 20:18:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:18:14.207175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e3479-84cc-4ba4-8481-189b76572a83 service swift] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:18:14.218483 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e3479-84cc-4ba4-8481-189b76572a83 service swift] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:18:14.223645 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707c02f-b217-4d08-a341-fbb77637d94c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a1eeb59bfa24e4bb6658aa4bb5f7852', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:18:14.224226 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c02f-b217-4d08-a341-fbb77637d94c service swift] REQUEST_METHOD: `GET` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:14.224497 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c02f-b217-4d08-a341-fbb77637d94c service swift] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:14.224767 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707c02f-b217-4d08-a341-fbb77637d94c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:14.233467 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707c02f-b217-4d08-a341-fbb77637d94c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:18:14.235076 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707c02f-b217-4d08-a341-fbb77637d94c service swift] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:18:14.243412 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1465/2923] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Aug 22 20:18:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:18:17.152106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b45d2-dc08-4247-814a-b0cc1b3f4d8c None None] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:18:17.215242 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b45d2-dc08-4247-814a-b0cc1b3f4d8c None None] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:18:17.220974 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:18:17.221602 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:17.221883 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:17.222159 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] PATH_INFO: `/v3/users/3b95c070ebb2452fbc7dbf76c55317c3` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:17.223440 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b95c070ebb2452fbc7dbf76c55317c3)` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:18:17.225480 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:18:17.399037 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:18:17.400808 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b95c070ebb2452fbc7dbf76c55317c3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:17.401493 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b95c070ebb2452fbc7dbf76c55317c3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:17.477189 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b95c070ebb2452fbc7dbf76c55317c3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:17.485246 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b95c070ebb2452fbc7dbf76c55317c3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:17.497731 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.notifications [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b95c070ebb2452fbc7dbf76c55317c3'} {{(pid=93485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:17.503853 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1459/2924] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Aug 22 20:18:17 2022] DELETE /identity/v3/users/3b95c070ebb2452fbc7dbf76c55317c3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:18:17.508465 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2c697-028e-43e1-b156-08b4235a8dfb None None] REQUEST_METHOD: `POST` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:17.508942 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2c697-028e-43e1-b156-08b4235a8dfb None None] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:17.509051 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2c697-028e-43e1-b156-08b4235a8dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:17.528278 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.auth.core [None req-ebe2c697-028e-43e1-b156-08b4235a8dfb None None] MFA Rules not processed for user `0cdd881142fc452aa383e6193f9f4daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93486) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:18:17.530237 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ebe2c697-028e-43e1-b156-08b4235a8dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:17.534324 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=100 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:18:17.588356 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1466/2925] 10.222.0.18 () {58 vars in 958 bytes} [Mon Aug 22 20:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:18:17.598874 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:18:17.600283 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:17.657720 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd42a8-e6bd-4b7c-b7e9-36556125e2de admin admin] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:18:17.661280 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66117f6-0f41-44cb-a930-79b037deab85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7500529eff574ca6ae3a9a77d72d2a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:18:17.661909 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66117f6-0f41-44cb-a930-79b037deab85 service neutron] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:17.662187 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66117f6-0f41-44cb-a930-79b037deab85 service neutron] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:17.662456 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66117f6-0f41-44cb-a930-79b037deab85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:17.671997 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66117f6-0f41-44cb-a930-79b037deab85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:18:17.673425 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66117f6-0f41-44cb-a930-79b037deab85 service neutron] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:18:17.682816 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1460/2926] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:18:17.913271 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2c697-028e-43e1-b156-08b4235a8dfb None None] Authenticating user token {{(pid=93486) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:18:17.916400 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.fernet_utils [None req-ebe2c697-028e-43e1-b156-08b4235a8dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93486) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:18:17.928175 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2c697-028e-43e1-b156-08b4235a8dfb None None] Validating token access rules against request {{(pid=93486) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:18:17.932863 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cdd881142fc452aa383e6193f9f4daa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51271e31587049bcaa892f314e138418', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93486) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:18:17.933489 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:18:17.933768 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] SCRIPT_NAME: `/identity` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:18:17.934038 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] PATH_INFO: `/v3/projects/df531b80519644d989fbe3319c8d2f0d` {{(pid=93486) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:18:17.935149 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df531b80519644d989fbe3319c8d2f0d)` {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:18:17.937168 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] RBAC: Authorization granted {{(pid=93486) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:18:18.040138 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df531b80519644d989fbe3319c8d2f0d', 'request_id': 'req-d4c4126d-1c8c-4768-a940-9535f0ef9530'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:18.046636 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df531b80519644d989fbe3319c8d2f0d', 'request_id': 'req-d4c4126d-1c8c-4768-a940-9535f0ef9530'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:18.052884 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df531b80519644d989fbe3319c8d2f0d', 'request_id': 'req-d4c4126d-1c8c-4768-a940-9535f0ef9530'} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:18.130462 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] The token cache is being invalidate because project df531b80519644d989fbe3319c8d2f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93486) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:18:18.130751 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:18.131409 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG keystone.notifications [None req-d4c4126d-1c8c-4768-a940-9535f0ef9530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93486) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:18:18.132904 dv-cinder-835384-22-smb devstack@keystone.service[93486]: [pid: 93486|app: 0|req: 1467/2927] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Aug 22 20:18:17 2022] DELETE /identity/v3/projects/df531b80519644d989fbe3319c8d2f0d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:18:27.678659 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:18:28.127066 dv-cinder-835384-22-smb devstack@keystone.service[93486]: DEBUG dbcounter [-] [93486] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93486) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:22:23.004007 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66117f6-0f41-44cb-a930-79b037deab85 service neutron] Authenticating user token {{(pid=93485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:22:23.007137 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-f66117f6-0f41-44cb-a930-79b037deab85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:22:23.075751 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66117f6-0f41-44cb-a930-79b037deab85 service neutron] Validating token access rules against request {{(pid=93485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:22:23.135193 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ffad1-e68b-43f6-a214-4ddb495c9a41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef51739456e4beb9ae0f107b13d55f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fec275f9ad4488bab9a1700808425d3', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:22:23.135825 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ffad1-e68b-43f6-a214-4ddb495c9a41 service placement] REQUEST_METHOD: `GET` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:22:23.136106 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ffad1-e68b-43f6-a214-4ddb495c9a41 service placement] SCRIPT_NAME: `/identity` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:22:23.136412 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ffad1-e68b-43f6-a214-4ddb495c9a41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:22:23.138136 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.fernet_utils [None req-209ffad1-e68b-43f6-a214-4ddb495c9a41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:22:23.149852 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ffad1-e68b-43f6-a214-4ddb495c9a41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:22:23.151463 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ffad1-e68b-43f6-a214-4ddb495c9a41 service placement] RBAC: Authorization granted {{(pid=93485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:22:23.161321 dv-cinder-835384-22-smb devstack@keystone.service[93485]: [pid: 93485|app: 0|req: 1461/2928] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Aug 22 20:22:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:22:33.157143 dv-cinder-835384-22-smb devstack@keystone.service[93485]: DEBUG dbcounter [-] [93485] Writing DB stats keystone:SELECT=58 {{(pid=93485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}